SingleReinforcementTuningRewardConfig

@Serializable
data class SingleReinforcementTuningRewardConfig(val autoraterScorer: ReinforcementTuningAutoraterScorer? = null, val rewardName: String? = null, val parseResponseConfig: ReinforcementTuningParseResponseConfig? = null, val codeExecutionRewardScorer: ReinforcementTuningCodeExecutionRewardScorer? = null, val stringMatchRewardScorer: ReinforcementTuningStringMatchRewardScorer? = null, val cloudRunRewardScorer: ReinforcementTuningCloudRunRewardScorer? = null)

Single reinforcement tuning reward config.

Constructors

Link copied to clipboard
constructor(autoraterScorer: ReinforcementTuningAutoraterScorer? = null, rewardName: String? = null, parseResponseConfig: ReinforcementTuningParseResponseConfig? = null, codeExecutionRewardScorer: ReinforcementTuningCodeExecutionRewardScorer? = null, stringMatchRewardScorer: ReinforcementTuningStringMatchRewardScorer? = null, cloudRunRewardScorer: ReinforcementTuningCloudRunRewardScorer? = null)

Properties

Link copied to clipboard

Scores parsed responses for autorater use cases by using a model to compute the reward.

Link copied to clipboard

ReinforcementTuningCloudRunRewardScorer is used to score parsed responses by calling a Cloud Run service.

Link copied to clipboard

ReinforcementTuningCodeExecutionRewardScorer is used to score parsed responses for code execution use cases.

Link copied to clipboard

Defines how to parse sample response. For example, given a sample response for evaluating the reward, users might want to extract the text only between ` and ` in the sample response, and keeps only the last one in case there are multiple such tags. To achieve such a purpose, they can define a regex ".*(.*?)" using the ReinforcementTuningParseResponseConfig.ResponseParseType.REGEX_EXTRACT parse type.

Link copied to clipboard
val rewardName: String? = null

A unique reward name for identifying each single reinforcement tuning reward.

Link copied to clipboard

ReinforcementTuningStringMatchRewardScorer is used to score parsed responses for simple string matching use cases against reference answers.