Docs / Routing

Provider selection

Control which upstream providers may serve your request.

Default behavior

Without preferences, the gateway picks a healthy, competitively priced provider automatically and retries across providers on failure.

JSON

{
  "model": "moonshotai/kimi-k3",
  "messages": [{"role": "user", "content": "Hello"}],
  "provider": {
    "order": ["primary-provider", "backup-provider"],
    "allow_fallbacks": true,
    "data_collection": "deny"
  }
}

Sorting

Sort candidates by price, throughput, or latency. Price sorting minimizes cost; throughput and latency sorting favor speed.

Pinning

Set allow_fallbacks to false to hard-pin a provider list — the request fails rather than leaking to an unlisted provider.