Interface DistillationSamplingSpec

Distillation sampling spec for tuning.

interface DistillationSamplingSpec {
    baseTeacherModel?: string;
    hyperparameters?: DistillationHyperParameters;
    promptDatasetUri?: string;
    tunedTeacherModelSource?: string;
    validationDatasetUri?: string;
}

Properties

baseTeacherModel?: string

The base teacher model that is being distilled. See Supported models.

Hyperparameters for distillation tuning.

promptDatasetUri?: string

Cloud Storage path to file containing prompt dataset for distillation. The dataset must be formatted as a JSONL file.

tunedTeacherModelSource?: string

The resource name of the Tuned teacher model. Format: projects/{project}/locations/{location}/models/{model}.

validationDatasetUri?: string

Cloud Storage path to file containing validation dataset for distillation. The dataset must be formatted as a JSONL file.