Interface WhiteSpaceConfig

Configuration for a white space chunking algorithm.

interface WhiteSpaceConfig {
    maxOverlapTokens?: number;
    maxTokensPerChunk?: number;
}

Properties

maxOverlapTokens? maxTokensPerChunk?

Properties

OptionalmaxOverlapTokens

maxOverlapTokens?: number

Maximum number of overlapping tokens between two adjacent chunks.

OptionalmaxTokensPerChunk

maxTokensPerChunk?: number

Maximum number of tokens per chunk.

Settings

On This Page

Properties