tokensInfo

public abstract Optional<List<TokensInfo>> tokensInfo()

Lists of tokens info from the input. A ComputeTokensRequest could have multiple instances with a prompt in each instance. We also need to return lists of tokens info for the request with multiple instances.