Routing

Updated

A model usually has offers from several providers. This group explains how the platform chooses among endpoints and how you can steer it:

  • Provider selection: the provider parameter, locking to an endpoint, and differences from OpenRouter.
  • Fallbacks: what allow_fallbacks means and its default.
  • Default routing: ordering, traffic splitting and session stickiness when you set nothing.
  • Data policy: endpoint data policy declarations, data_collection and data processing regions.
  • Budgets and limits: balance, key spend limits, rate limits and price caps.