Optional
generationThe generation configuration for the session.
The following fields are supported:
response_logprobs
response_mime_type
logprobs
response_schema
stop_sequence
routing_config
audio_timestamp
Optional
modelThe fully qualified name of the publisher model or tuned model endpoint to use.
Optional
systemThe user provided system instructions for the model. Note: only text should be used in parts and content in each part will be in a separate paragraph.
Optional
toolsA list of Tools
the model may use to generate the next response.
A Tool
is a piece of code that enables the system to interact with
external systems to perform an action, or set of actions, outside of
knowledge and scope of the model.
Message contains configuration that will apply for the duration of the streaming session.