Constructor Detail

• LLMBasedMetricSpec.Builder

  LLMBasedMetricSpec.Builder()

Method Detail

• metricPromptTemplate

   abstract LLMBasedMetricSpec.Builder metricPromptTemplate(String metricPromptTemplate)

  Setter for metricPromptTemplate.

  metricPromptTemplate: Template for the prompt sent to the judge model.

• clearMetricPromptTemplate

  @CanIgnoreReturnValue() LLMBasedMetricSpec.Builder clearMetricPromptTemplate()

  Clears the value of metricPromptTemplate field.

• systemInstruction

   abstract LLMBasedMetricSpec.Builder systemInstruction(String systemInstruction)

  Setter for systemInstruction.

  systemInstruction: System instruction for the judge model.

• clearSystemInstruction

  @CanIgnoreReturnValue() LLMBasedMetricSpec.Builder clearSystemInstruction()

  Clears the value of systemInstruction field.

• judgeAutoraterConfig

   abstract LLMBasedMetricSpec.Builder judgeAutoraterConfig(AutoraterConfig judgeAutoraterConfig)

  Setter for judgeAutoraterConfig.

  judgeAutoraterConfig: Optional configuration for the judge LLM (Autorater).

• judgeAutoraterConfig

  @CanIgnoreReturnValue() LLMBasedMetricSpec.Builder judgeAutoraterConfig(AutoraterConfig.Builder judgeAutoraterConfigBuilder)

  Setter for judgeAutoraterConfig builder.

  judgeAutoraterConfig: Optional configuration for the judge LLM (Autorater).

• clearJudgeAutoraterConfig

  @CanIgnoreReturnValue() LLMBasedMetricSpec.Builder clearJudgeAutoraterConfig()

  Clears the value of judgeAutoraterConfig field.

• rubricGroupKey

   abstract LLMBasedMetricSpec.Builder rubricGroupKey(String rubricGroupKey)

  Setter for rubricGroupKey.

  rubricGroupKey: Use a pre-defined group of rubrics associated with the input. Refers to a key in the rubric_groups map of EvaluationInstance.

• clearRubricGroupKey

  @CanIgnoreReturnValue() LLMBasedMetricSpec.Builder clearRubricGroupKey()

  Clears the value of rubricGroupKey field.

• predefinedRubricGenerationSpec

   abstract LLMBasedMetricSpec.Builder predefinedRubricGenerationSpec(PredefinedMetricSpec predefinedRubricGenerationSpec)

  Setter for predefinedRubricGenerationSpec.

  predefinedRubricGenerationSpec: Dynamically generate rubrics using a predefined spec.

• predefinedRubricGenerationSpec

  @CanIgnoreReturnValue() LLMBasedMetricSpec.Builder predefinedRubricGenerationSpec(PredefinedMetricSpec.Builder predefinedRubricGenerationSpecBuilder)

  Setter for predefinedRubricGenerationSpec builder.

  predefinedRubricGenerationSpec: Dynamically generate rubrics using a predefined spec.

• clearPredefinedRubricGenerationSpec

  @CanIgnoreReturnValue() LLMBasedMetricSpec.Builder clearPredefinedRubricGenerationSpec()

  Clears the value of predefinedRubricGenerationSpec field.

• rubricGenerationSpec

   abstract LLMBasedMetricSpec.Builder rubricGenerationSpec(RubricGenerationSpec rubricGenerationSpec)

  Setter for rubricGenerationSpec.

  rubricGenerationSpec: Dynamically generate rubrics using this specification.

• rubricGenerationSpec

  @CanIgnoreReturnValue() LLMBasedMetricSpec.Builder rubricGenerationSpec(RubricGenerationSpec.Builder rubricGenerationSpecBuilder)

  Setter for rubricGenerationSpec builder.

  rubricGenerationSpec: Dynamically generate rubrics using this specification.

• clearRubricGenerationSpec

  @CanIgnoreReturnValue() LLMBasedMetricSpec.Builder clearRubricGenerationSpec()

  Clears the value of rubricGenerationSpec field.

• additionalConfig

   abstract LLMBasedMetricSpec.Builder additionalConfig(Map<String, Object> additionalConfig)

  Setter for additionalConfig.

  additionalConfig: Optional. Optional additional configuration for the metric.

• clearAdditionalConfig

  @CanIgnoreReturnValue() LLMBasedMetricSpec.Builder clearAdditionalConfig()

  Clears the value of additionalConfig field.

• build

   abstract LLMBasedMetricSpec build()