Class LLMBasedMetricSpec.Builder
- Enclosing class:
- LLMBasedMetricSpec
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionabstract LLMBasedMetricSpec.BuilderadditionalConfig(Map<String, Object> additionalConfig) Setter for additionalConfig.abstract LLMBasedMetricSpecbuild()Clears the value of additionalConfig field.Clears the value of judgeAutoraterConfig field.Clears the value of metricPromptTemplate field.Clears the value of predefinedRubricGenerationSpec field.Clears the value of rubricGenerationSpec field.Clears the value of rubricGroupKey field.Clears the value of systemInstruction field.abstract LLMBasedMetricSpec.BuilderjudgeAutoraterConfig(AutoraterConfig judgeAutoraterConfig) Setter for judgeAutoraterConfig.judgeAutoraterConfig(AutoraterConfig.Builder judgeAutoraterConfigBuilder) Setter for judgeAutoraterConfig builder.abstract LLMBasedMetricSpec.BuildermetricPromptTemplate(String metricPromptTemplate) Setter for metricPromptTemplate.abstract LLMBasedMetricSpec.BuilderpredefinedRubricGenerationSpec(PredefinedMetricSpec predefinedRubricGenerationSpec) Setter for predefinedRubricGenerationSpec.predefinedRubricGenerationSpec(PredefinedMetricSpec.Builder predefinedRubricGenerationSpecBuilder) Setter for predefinedRubricGenerationSpec builder.abstract LLMBasedMetricSpec.BuilderrubricGenerationSpec(RubricGenerationSpec rubricGenerationSpec) Setter for rubricGenerationSpec.rubricGenerationSpec(RubricGenerationSpec.Builder rubricGenerationSpecBuilder) Setter for rubricGenerationSpec builder.abstract LLMBasedMetricSpec.BuilderrubricGroupKey(String rubricGroupKey) Setter for rubricGroupKey.abstract LLMBasedMetricSpec.BuildersystemInstruction(String systemInstruction) Setter for systemInstruction.
-
Constructor Details
-
Builder
public Builder()
-
-
Method Details
-
metricPromptTemplate
Setter for metricPromptTemplate.metricPromptTemplate: Template for the prompt sent to the judge model.
-
clearMetricPromptTemplate
Clears the value of metricPromptTemplate field. -
systemInstruction
Setter for systemInstruction.systemInstruction: System instruction for the judge model.
-
clearSystemInstruction
Clears the value of systemInstruction field. -
judgeAutoraterConfig
public abstract LLMBasedMetricSpec.Builder judgeAutoraterConfig(AutoraterConfig judgeAutoraterConfig) Setter for judgeAutoraterConfig.judgeAutoraterConfig: Optional configuration for the judge LLM (Autorater).
-
judgeAutoraterConfig
@CanIgnoreReturnValue public LLMBasedMetricSpec.Builder judgeAutoraterConfig(AutoraterConfig.Builder judgeAutoraterConfigBuilder) Setter for judgeAutoraterConfig builder.judgeAutoraterConfig: Optional configuration for the judge LLM (Autorater).
-
clearJudgeAutoraterConfig
Clears the value of judgeAutoraterConfig field. -
rubricGroupKey
Setter for rubricGroupKey.rubricGroupKey: Use a pre-defined group of rubrics associated with the input. Refers to a key in the rubric_groups map of EvaluationInstance.
-
clearRubricGroupKey
Clears the value of rubricGroupKey field. -
predefinedRubricGenerationSpec
public abstract LLMBasedMetricSpec.Builder predefinedRubricGenerationSpec(PredefinedMetricSpec predefinedRubricGenerationSpec) Setter for predefinedRubricGenerationSpec.predefinedRubricGenerationSpec: Dynamically generate rubrics using a predefined spec.
-
predefinedRubricGenerationSpec
@CanIgnoreReturnValue public LLMBasedMetricSpec.Builder predefinedRubricGenerationSpec(PredefinedMetricSpec.Builder predefinedRubricGenerationSpecBuilder) Setter for predefinedRubricGenerationSpec builder.predefinedRubricGenerationSpec: Dynamically generate rubrics using a predefined spec.
-
clearPredefinedRubricGenerationSpec
Clears the value of predefinedRubricGenerationSpec field. -
rubricGenerationSpec
public abstract LLMBasedMetricSpec.Builder rubricGenerationSpec(RubricGenerationSpec rubricGenerationSpec) Setter for rubricGenerationSpec.rubricGenerationSpec: Dynamically generate rubrics using this specification.
-
rubricGenerationSpec
@CanIgnoreReturnValue public LLMBasedMetricSpec.Builder rubricGenerationSpec(RubricGenerationSpec.Builder rubricGenerationSpecBuilder) Setter for rubricGenerationSpec builder.rubricGenerationSpec: Dynamically generate rubrics using this specification.
-
clearRubricGenerationSpec
Clears the value of rubricGenerationSpec field. -
additionalConfig
Setter for additionalConfig.additionalConfig: Optional. Optional additional configuration for the metric.
-
clearAdditionalConfig
Clears the value of additionalConfig field. -
build
-