LLMBasedMetricSpec

public abstract class LLMBasedMetricSpec extends JsonSerializable

Specification for an LLM based metric.

Constructors

Link copied to clipboard
public void LLMBasedMetricSpec()

Types

Link copied to clipboard
public abstract class Builder
Builder for LLMBasedMetricSpec.

Properties

Link copied to clipboard
public final static String MAX_READ_LENGTH_PROPERTY
System property to override the default max JSON string length (20MB) in read constraints.

Functions

Link copied to clipboard
public abstract Optional<Map<String, Object>> additionalConfig()
Optional.
Link copied to clipboard
Instantiates a builder for LLMBasedMetricSpec.
Link copied to clipboard
public static LLMBasedMetricSpec fromJson(String jsonString)
Deserializes a JSON string to a LLMBasedMetricSpec object.
Link copied to clipboard
@InternalApi()
public static T fromJsonNode<T extends JsonSerializable>(JsonNode jsonNode, Class<T> clazz)
Deserializes a JsonNode to an object of the given type.
Link copied to clipboard
@InternalApi()
public static T fromJsonString<T extends JsonSerializable>(String jsonString, Class<T> clazz)
Deserializes a Json string to an object of the given type.
Link copied to clipboard
Optional configuration for the judge LLM (Autorater).
Link copied to clipboard
Template for the prompt sent to the judge model.
Link copied to clipboard
public static ObjectMapper objectMapper()
Link copied to clipboard
Dynamically generate rubrics using a predefined spec.
Link copied to clipboard
Dynamically generate rubrics using this specification.
Link copied to clipboard
public abstract Optional<String> rubricGroupKey()
Use a pre-defined group of rubrics associated with the input.
Link copied to clipboard
public static void setMaxReadLength(int maxReadLength)
Overrides the default maximum JSON string length (20MB) for the JSON parser.
Link copied to clipboard
public static JsonNode stringToJsonNode(String string)
Converts a Json string to a JsonNode.
Link copied to clipboard
public abstract Optional<String> systemInstruction()
System instruction for the judge model.
Link copied to clipboard
Creates a builder with the same values as this instance.
Link copied to clipboard
public String toJson()
Serializes the instance to a Json string.
Link copied to clipboard
public static JsonNode toJsonNode(Object object)
Serializes an object to a JsonNode.
Link copied to clipboard
public static String toJsonString(Object object)
Serializes an object to a Json string.