Interface GenerationConfigRoutingConfigAutoRoutingMode

When automated routing is specified, the routing will be determined by the pretrained routing model and customer provided model routing preference.

interface GenerationConfigRoutingConfigAutoRoutingMode {
    modelRoutingPreference?:
        | "UNKNOWN"
        | "PRIORITIZE_QUALITY"
        | "BALANCED"
        | "PRIORITIZE_COST";
}

Properties

modelRoutingPreference?

Properties

OptionalmodelRoutingPreference

modelRoutingPreference?:
    | "UNKNOWN"
    | "PRIORITIZE_QUALITY"
    | "BALANCED"
    | "PRIORITIZE_COST"

The model routing preference.

Settings

On This Page

Properties
MMNEPVFCICPMFPCPTTAAATR