A list of the top candidate tokens and their log probabilities at each decoding step. This can be used to see what other tokens the model considered.
Optional
The list of candidate tokens, sorted by log probability in descending order.
A list of the top candidate tokens and their log probabilities at each decoding step. This can be used to see what other tokens the model considered.