Local
Creates a new LocalTokenizer for the specified model.
Parameters
model
the name of the model to load (e.g., "gemini-2.5-flash")
Throws
if the model name is not supported or the tokenizer cannot be loaded
Creates a new LocalTokenizer for the specified model.
the name of the model to load (e.g., "gemini-2.5-flash")
if the model name is not supported or the tokenizer cannot be loaded