Optional
activityMarks the end of user activity.
Optional
activityMarks the start of user activity.
Optional
audioThe realtime audio input stream.
Optional
audioIndicates that the audio stream has ended, e.g. because the microphone was turned off.
This should only be sent when automatic activity detection is enabled (which is the default).
The client can reopen the stream by sending an audio message.
Optional
mediaInlined bytes data for media input.
Optional
textThe realtime text input stream.
Optional
videoThe realtime video input stream.
User input that is sent in real time.
This is different from
LiveClientContent
in a few ways:LiveClientContent
and theLiveClientRealtimeInput
, server attempts to optimize for best response, but there are no guarantees.