Skip to main content
Section ID: DOC-API-MODEL-schema-1gg690bhqh#overview

ProviderPreferences

Routing preferences restricting and ordering the model providers eligible for a request.

Type-reference view: API Schema 9frhv4euve, API Schema 9ftjkkjhfa. Request and response views describe this type; they do not declare an endpoint.

Meaning and usage​

Section ID: DOC-API-MODEL-schema-1gg690bhqh#meaning

See the definition above.

Usage profiles​

Section ID: DOC-API-MODEL-schema-1gg690bhqh#fields

UsageFields and validation
In requestsView fields
In responsesView fields

In requests​

Section ID: DOC-API-MODEL-schema-1gg690bhqh#request

API JSON uses JSON field names (camelCase).

FieldTypePresenceMeaning
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-orderorderArray of stringOptionalPreferred ordering of model providers for routing.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-allowfallbacksallowFallbacksbooleanOptionalThe current chat routing path enables provider fallbacks even when this value is false or omitted. This field cannot disable fallback in that path. Use only to restrict eligible providers; confirm the selected providers support the requested model.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-requireparametersrequireParametersbooleanOptionalWhether routing requires providers to support the requested parameters.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-datacollectiondataCollectionstring (DATA_COLLECTION_MODE_ALLOW, DATA_COLLECTION_MODE_DENY) or integer (int32)Optional; explicit presenceProvider data-collection preference used when routing the request.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-zdrzdrbooleanOptionalWhether routing requests providers offering zero data retention.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-onlyonlyArray of stringOptionalProvider identifiers allowed by the routing preference.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-ignoreignoreArray of stringOptionalProvider identifiers excluded by the routing preference.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-quantizationsquantizationsArray of stringOptionalSee meaning below.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-sortsortstring (PROVIDER_SORT_PRICE, PROVIDER_SORT_THROUGHPUT, PROVIDER_SORT_LATENCY) or integer (int32)Optional; explicit presenceMetric used to order eligible model providers.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-maxpricemaxPriceProviderMaxPriceOptionalUpper price bounds used when selecting a model provider.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-enforcedistillabletextenforceDistillableTextbooleanOptionalEmbeddings: enforce distillable text.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-preferredminthroughputpreferredMinThroughputPercentileThresholdOptionalDeprioritize providers below this throughput (tokens/sec). Does not exclude — just pushes to end of preference list.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-field-preferredmaxlatencypreferredMaxLatencyPercentileThresholdOptionalDeprioritize providers above this latency (ms).

quantizations

Model quantization formats allowed by the routing preference.

generic string for portability

Values of dataCollection​

Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-values-datacollection

Provider-routing preference for whether providers may collect submitted data.

ValueNo.FormMeaning
DATA_COLLECTION_MODE_ALLOW0CanonicalAllow routing to providers that may collect submitted data under their policies.
DATA_COLLECTION_MODE_DENY1CanonicalRequest routing only to providers that do not collect submitted data under the routing policy.

Values of sort​

Section ID: DOC-API-MODEL-schema-1gg690bhqh#request-values-sort

Metric used to order eligible model providers.

ValueNo.FormMeaning
PROVIDER_SORT_PRICE0CanonicalPrefer providers with lower price.
PROVIDER_SORT_THROUGHPUT1CanonicalPrefer providers with higher throughput.
PROVIDER_SORT_LATENCY2CanonicalPrefer providers with lower latency.

In responses​

Section ID: DOC-API-MODEL-schema-1gg690bhqh#response

API JSON uses JSON field names (camelCase).

FieldTypePresenceMeaning
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-orderSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-orderorderArray of stringOptionalPreferred ordering of model providers for routing.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-allowfallbacksSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-allowfallbacksallowFallbacksbooleanOptionalThe current chat routing path enables provider fallbacks even when this value is false or omitted. This field cannot disable fallback in that path. Use only to restrict eligible providers; confirm the selected providers support the requested model.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-requireparametersSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-requireparametersrequireParametersbooleanOptionalWhether routing requires providers to support the requested parameters.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-datacollectionSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-datacollectiondataCollectionstring (DATA_COLLECTION_MODE_ALLOW, DATA_COLLECTION_MODE_DENY) or integer (int32)Optional; explicit presenceProvider data-collection preference used when routing the request.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-zdrSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-zdrzdrbooleanOptionalWhether routing requests providers offering zero data retention.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-onlySection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-onlyonlyArray of stringOptionalProvider identifiers allowed by the routing preference.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-ignoreSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-ignoreignoreArray of stringOptionalProvider identifiers excluded by the routing preference.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-quantizationsSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-quantizationsquantizationsArray of stringOptionalSee meaning below.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-sortSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-sortsortstring (PROVIDER_SORT_PRICE, PROVIDER_SORT_THROUGHPUT, PROVIDER_SORT_LATENCY) or integer (int32)Optional; explicit presenceMetric used to order eligible model providers.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-maxpriceSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-maxpricemaxPriceProviderMaxPriceOptionalUpper price bounds used when selecting a model provider.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-enforcedistillabletextSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-enforcedistillabletextenforceDistillableTextbooleanOptionalEmbeddings: enforce distillable text.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-preferredminthroughputSection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-preferredminthroughputpreferredMinThroughputPercentileThresholdOptionalDeprioritize providers below this throughput (tokens/sec). Does not exclude — just pushes to end of preference list.
Section ID: DOC-API-MODEL-schema-1gg690bhqh#field-preferredmaxlatencySection ID: DOC-API-MODEL-schema-1gg690bhqh#response-field-preferredmaxlatencypreferredMaxLatencyPercentileThresholdOptionalDeprioritize providers above this latency (ms).

quantizations

Model quantization formats allowed by the routing preference.

generic string for portability

Values of dataCollection​

Section ID: DOC-API-MODEL-schema-1gg690bhqh#response-values-datacollection

Provider-routing preference for whether providers may collect submitted data.

ValueNo.FormMeaning
DATA_COLLECTION_MODE_ALLOW0CanonicalAllow routing to providers that may collect submitted data under their policies.
DATA_COLLECTION_MODE_DENY1CanonicalRequest routing only to providers that do not collect submitted data under the routing policy.

Values of sort​

Section ID: DOC-API-MODEL-schema-1gg690bhqh#response-values-sort

Metric used to order eligible model providers.

ValueNo.FormMeaning
PROVIDER_SORT_PRICE0CanonicalPrefer providers with lower price.
PROVIDER_SORT_THROUGHPUT1CanonicalPrefer providers with higher throughput.
PROVIDER_SORT_LATENCY2CanonicalPrefer providers with lower latency.

Where used​

Section ID: DOC-API-MODEL-schema-1gg690bhqh#where-used

ReferenceRelationship
Create an agent profilePOST /api/v1/agent-profiles/create
Get an agent profilePOST /api/v1/agent-profiles/get
Import a prompt libraryPOST /api/v1/agent-profiles/import
List agent profilesPOST /api/v1/agent-profiles/list
Update an agent profilePOST /api/v1/agent-profiles/update
Withdraw your rating on a messagePOST /api/v1/llm/delete-message-rating
Get full conversation statePOST /api/v1/llm/conversation-state
Rate an assistant messagePOST /api/v1/llm/rate-message
Send a message and wait for the resultPOST /api/v1/llm/send-message-sync
Submit client-side tool results and wait for the next segmentPOST /api/v1/llm/submit-client-tool-results-sync
Update context management settingsPOST /api/v1/llm/update-context-management-settings
Update default generation configPOST /api/v1/llm/update-default-generation-config
Get the caller's end-user profilePOST /api/v1/enduser/get
Append a message without generatingPOST /api/v1/llm/append-message
Create a new conversation threadPOST /api/v1/llm/create-thread
Send a message to a conversationPOST /api/v1/llm/send-message
Update the caller's default generation configPOST /api/v1/enduser/update-generation-config
ReceiveMessageRequestAPI JSON uses JSON field names (camelCase).
ClientToolDispatchAPI JSON uses JSON field names (camelCase).
Models containing this value
ModelRelationship
GenerationConfigNested in model
GenerationConfigNested in model

Download the public reference contract.

Document ID: DOC-API-MODEL-schema-1gg690bhqh