Tokens info with a list of tokens and the corresponding list of token ids.
Optional
Optional. Optional fields for the role from the corresponding Content.
A list of token ids from the input.
A list of tokens from the input.
Tokens info with a list of tokens and the corresponding list of token ids.