Interface GenerationConfig

Generation config.

interface GenerationConfig {
    audioTimestamp?: boolean;
    candidateCount?: number;
    frequencyPenalty?: number;
    logprobs?: number;
    maxOutputTokens?: number;
    presencePenalty?: number;
    responseLogprobs?: boolean;
    responseMimeType?: string;
    responseSchema?: Schema;
    routingConfig?: GenerationConfigRoutingConfig;
    seed?: number;
    stopSequences?: string[];
    temperature?: number;
    topK?: number;
    topP?: number;
}

Properties

audioTimestamp? candidateCount? frequencyPenalty? logprobs? maxOutputTokens? presencePenalty? responseLogprobs? responseMimeType? responseSchema? routingConfig? seed? stopSequences? temperature? topK? topP?

Properties

OptionalaudioTimestamp

audioTimestamp?: boolean

Optional. If enabled, audio timestamp will be included in the request to the model.

OptionalcandidateCount

candidateCount?: number

Optional. Number of candidates to generate.

OptionalfrequencyPenalty

frequencyPenalty?: number

Optional. Frequency penalties.

Optionallogprobs

logprobs?: number

Optional. Logit probabilities.

OptionalmaxOutputTokens

maxOutputTokens?: number

Optional. The maximum number of output tokens to generate per message.

OptionalpresencePenalty

presencePenalty?: number

Optional. Positive penalties.

OptionalresponseLogprobs

responseLogprobs?: boolean

Optional. If true, export the logprobs results in response.

OptionalresponseMimeType

responseMimeType?: string

Optional. Output response mimetype of the generated candidate text. Supported mimetype: - text/plain: (default) Text output. - application/json: JSON response in the candidates. The model needs to be prompted to output the appropriate response type, otherwise the behavior is undefined. This is a preview feature.

OptionalresponseSchema

responseSchema?: Schema

Optional. The Schema object allows the definition of input and output data types. These types can be objects, but also primitives and arrays. Represents a select subset of an OpenAPI 3.0 schema object. If set, a compatible response_mime_type must also be set. Compatible mimetypes: application/json: Schema for JSON response.

OptionalroutingConfig

routingConfig?: GenerationConfigRoutingConfig

Optional. Routing configuration.

Optionalseed

seed?: number

Optional. Seed.

OptionalstopSequences

stopSequences?: string[]

Optional. Stop sequences.

Optionaltemperature

temperature?: number

Optional. Controls the randomness of predictions.

OptionaltopK

topK?: number

Optional. If specified, top-k sampling will be used.

OptionaltopP

topP?: number

Optional. If specified, nucleus sampling will be used.

Settings

On This Page

Properties
MMNEPVFCICPMFPCPTTAAATR