Class Model.Builder

  • All Implemented Interfaces:

    
    public abstract class Model.Builder
    
                        

    Builder for Model.

    • Constructor Detail

      • Model.Builder

        Model.Builder()
    • Method Detail

      • version

         abstract Model.Builder version(String version)

        Setter for version.

        version: Version ID of the model. A new version is committed when a new model version is uploaded or trained under an existing model ID. The version ID is an auto-incrementing decimal number in string representation.

      • endpoints

         abstract Model.Builder endpoints(List<Endpoint> endpoints)

        Setter for endpoints.

        endpoints: List of deployed models created from this base model. Note that a model could have been deployed to endpoints in different locations.

      • endpoints

        @CanIgnoreReturnValue() Model.Builder endpoints(Array<Endpoint> endpoints)

        Setter for endpoints.

        endpoints: List of deployed models created from this base model. Note that a model could have been deployed to endpoints in different locations.

      • endpoints

        @CanIgnoreReturnValue() Model.Builder endpoints(Array<Endpoint.Builder> endpointsBuilders)

        Setter for endpoints builder.

        endpoints: List of deployed models created from this base model. Note that a model could have been deployed to endpoints in different locations.

      • inputTokenLimit

         abstract Model.Builder inputTokenLimit(Integer inputTokenLimit)

        Setter for inputTokenLimit.

        inputTokenLimit: The maximum number of input tokens that the model can handle.

      • outputTokenLimit

         abstract Model.Builder outputTokenLimit(Integer outputTokenLimit)

        Setter for outputTokenLimit.

        outputTokenLimit: The maximum number of output tokens that the model can generate.

      • supportedActions

        @CanIgnoreReturnValue() Model.Builder supportedActions(Array<String> supportedActions)

        Setter for supportedActions.

        supportedActions: List of actions that are supported by the model.

      • defaultCheckpointId

         abstract Model.Builder defaultCheckpointId(String defaultCheckpointId)

        Setter for defaultCheckpointId.

        defaultCheckpointId: The default checkpoint id of a model version.

      • temperature

         abstract Model.Builder temperature(Float temperature)

        Setter for temperature.

        temperature: Temperature value used for sampling set when the dataset was saved. This value is used to tune the degree of randomness.

      • maxTemperature

         abstract Model.Builder maxTemperature(Float maxTemperature)

        Setter for maxTemperature.

        maxTemperature: The maximum temperature value used for sampling set when the dataset was saved. This value is used to tune the degree of randomness.

      • topP

         abstract Model.Builder topP(Float topP)

        Setter for topP.

        topP: Optional. Specifies the nucleus sampling threshold. The model considers only the smallest set of tokens whose cumulative probability is at least `top_p`. This helps generate more diverse and less repetitive responses. For example, a `top_p` of 0.9 means the model considers tokens until the cumulative probability of the tokens to select from reaches 0.9. It's recommended to adjust either temperature or `top_p`, but not both.

      • topK

         abstract Model.Builder topK(Integer topK)

        Setter for topK.

        topK: Optional. Specifies the top-k sampling threshold. The model considers only the top k most probable tokens for the next token. This can be useful for generating more coherent and less random text. For example, a `top_k` of 40 means the model will choose the next word from the 40 most likely words.

      • thinking

         abstract Model.Builder thinking(boolean thinking)

        Setter for thinking.

        thinking: Whether the model supports thinking features. If true, thoughts are returned only if the model supports thought and thoughts are available.