Logprobs Result Top Candidates
@Serializable
A list of the top candidate tokens and their log probabilities at each decoding step. This can be used to see what other tokens the model considered.
A list of the top candidate tokens and their log probabilities at each decoding step. This can be used to see what other tokens the model considered.