Optional
audioOptional. If enabled, audio timestamp will be included in the request to the model.
Optional
candidateOptional. Number of candidates to generate.
Optional
frequencyOptional. Frequency penalties.
Optional
logprobsOptional. Logit probabilities.
Optional
maxOptional. The maximum number of output tokens to generate per message.
Optional
presenceOptional. Positive penalties.
Optional
responseOptional. If true, export the logprobs results in response.
Optional
responseOptional. Output response mimetype of the generated candidate text. Supported mimetype: - text/plain
: (default) Text output. - application/json
: JSON response in the candidates. The model needs to be prompted to output the appropriate response type, otherwise the behavior is undefined. This is a preview feature.
Optional
responseOptional. The Schema
object allows the definition of input and output data types. These types can be objects, but also primitives and arrays. Represents a select subset of an OpenAPI 3.0 schema object. If set, a compatible response_mime_type must also be set. Compatible mimetypes: application/json
: Schema for JSON response.
Optional
routingOptional. Routing configuration.
Optional
seedOptional. Seed.
Optional
stopOptional. Stop sequences.
Optional
temperatureOptional. Controls the randomness of predictions.
Optional
topKOptional. If specified, top-k sampling will be used.
Optional
topPOptional. If specified, nucleus sampling will be used.
Generation config.