ContextWindowCompressionConfig

@Serializable

data class ContextWindowCompressionConfig(val triggerTokens: Long? = null, val slidingWindow: SlidingWindow? = null)

Enables context window compression -- mechanism managing model context window so it does not exceed given length.

Constructors

constructor(triggerTokens: Long? = null, slidingWindow: SlidingWindow? = null)

Sliding window compression mechanism.

Number of tokens (before running turn) that triggers context window compression mechanism.