AI & Agents

Perplexity Launches an Orchestrator API With Provider Failover and Model Routing

Leave a comment

Perplexity has launched the Perplexity Orchestrator API, MarkTechPost reports, a single hosted endpoint for frontier and open-weight models with unified billing. It covers models from OpenAI, Anthropic, Google, and xAI, plus open-weight models such as GLM, Kimi, and DeepSeek served by Perplexity or inference partners. Requests can use the OpenAI Chat Completions, OpenAI Responses, or Anthropic Messages formats. For most teams, the switch is an API key and a base URL. Failover keeps the model the same and changes the deployment if a provider errors, rate-limits, or times out. A Claude request that fails at Anthropic, for example, can be served from AWS Bedrock instead. Invalid or over-context requests are not retried. If every deployment fails, the API returns HTTP 429. Requests that fail before producing output are not billed. You cannot pick the deployment yourself.

Automatic routing with perplexity/auto is still in preview. You pass a default model and up to five named routes; a decision model reads the conversation and the route descriptions, not the route names or model IDs. Perplexity also measured production traffic from October 4 to November 2, 2026, and says Claude and GPT requests through Orchestrator succeeded more often than requests to any single provider it measured, without publishing percentage success rates. I have not used the API, and I am treating those reliability claims as the company’s own measurements.

My take

One bill and same-model failover is a practical pitch if you already juggle several providers. The routing preview is the more experimental part, and I would not take a vendor’s traffic study as the last word. If you try it, start with a workload you can measure yourself.

God Bless, and Happy hacking!

References & Further Reading

Subscribe (RSS) Follow AI & Agents via RSS

Leave a note

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.