Interface ContextWindowCompressionConfig

Enables context window compression -- mechanism managing model context window so it does not exceed given length.

interface ContextWindowCompressionConfig {
slidingWindow?: SlidingWindow;
triggerTokens?: string;
}

Properties

slidingWindow?: SlidingWindow

Sliding window compression mechanism.

triggerTokens?: string

Number of tokens (before running turn) that triggers context window compression mechanism.