TokensInfo

@Serializable

data class TokensInfo(val role: String? = null, val tokenIds: List<Long>? = null, val tokens: List<@Serializable(with = ByteArrayAsBase64Serializer::class) ByteArray>? = null)

Tokens info with a list of tokens and the corresponding list of token ids.

Constructors

constructor(role: String? = null, tokenIds: List<Long>? = null, tokens: List<@Serializable(with = ByteArrayAsBase64Serializer::class) ByteArray>? = null)

val role: String? = null

Optional fields for the role from the corresponding Content.

A list of token ids from the input.

A list of tokens from the input.