google-genai/com.google.genai/LocalTokenizer/countTokens

countTokens

public CountTokensResult countTokens(List<Content> contents, CountTokensConfig config)

Counts the number of tokens in a given text.

Return

A CountTokensResult containing the total number of tokens.

Parameters

contents

The contents to tokenize.

config

The configuration for counting tokens.

public CountTokensResult countTokens(List<Content> contents)

Counts the number of tokens in a list of content objects using default configuration.

Return

A CountTokensResult containing the total number of tokens.

Parameters

contents

The contents to tokenize.

public CountTokensResult countTokens(Content content, CountTokensConfig config)

Counts the number of tokens in a single content object.

Return

A CountTokensResult containing the total number of tokens.

Parameters

content

The content to tokenize.

config

The configuration for counting tokens.

public CountTokensResult countTokens(Content content)

Counts the number of tokens in a single content object using default configuration.

Return

A CountTokensResult containing the total number of tokens.

Parameters

content

The content to tokenize.

public CountTokensResult countTokens(String content, CountTokensConfig config)

Counts the number of tokens in a text string.

Return

A CountTokensResult containing the total number of tokens.

Parameters

content

The text content to tokenize.

config

The configuration for counting tokens.

public CountTokensResult countTokens(String content)

Counts the number of tokens in a text string using default configuration.

Return

A CountTokensResult containing the total number of tokens.

Parameters

content

The text content to tokenize.