Sliding Window
Context window will be truncated by keeping only suffix of it.
Context window will always be cut at start of USER role turn. System instructions and `BidiGenerateContentSetup.prefix_turns` will not be subject to the sliding window mechanism, they will always stay at the beginning of context window.
Properties
Functions
Link copied to clipboard
Instantiates a builder for SlidingWindow.
Link copied to clipboard
Deserializes a JSON string to a SlidingWindow object.
Link copied to clipboard
@InternalApi()
Deserializes a JsonNode to an object of the given type.
Link copied to clipboard
@InternalApi()
Deserializes a Json string to an object of the given type.
Link copied to clipboard
Link copied to clipboard
Overrides the default maximum JSON string length (20MB) for the JSON parser.
Link copied to clipboard
Converts a Json string to a JsonNode.
Link copied to clipboard
Session reduction target -- how many tokens we should keep.
Link copied to clipboard
Creates a builder with the same values as this instance.
Link copied to clipboard
Serializes an object to a JsonNode.
Link copied to clipboard
Serializes an object to a Json string.