Model routing companies, products & suppliers

Choosing which model handles a request for quality, cost or latency. Jobs: quality-based routing; cost-aware fallbacks; a/b between models.

What is Model routing?

Choosing which model handles a request for quality, cost or latency. Jobs: quality-based routing; cost-aware fallbacks; a/b between models.

What problems does it solve?

One model is used for every task, wasting cost or quality.

Typical business use cases

  • Quality-based routing
  • Cost-aware fallbacks
  • A/B between models

Important capabilities

  • Router policy
  • Eval hooks
  • Fallback

What buyers should evaluate

  • How the router decides
  • Eval honesty
  • Lock-in

Risks and governance considerations

Silent routing to a cheaper model that fails the original eval.

Procurement checklist

  • Decision logs
  • Eval set
  • Override

Relevant AI Trustmark assurance

AI Trustmark independent findings appear only when an assessment or certificate exists. Category membership does not imply verification.

Methodology · How verification works

Companies and providers

Claimed suppliers appear first so buyers can start with listings the company has taken ownership of. Payment does not buy this order.

  • AI/ML API

    Access 1000+ AI models through a single API for text, image, video, audio, code, embeddings, and more. Compare pricing, latency, and capabilities—all in one place with AIMLAPI. AI/

  • Amazon Web Services

    Amazon Web Services is Amazon's cloud division selling compute, storage, Bedrock model hosting and related AI infrastructure. Public pages cover regional cloud services for builder

  • Braintrust

    Ship quality agents at scale. Braintrust is the AI observability platform for tracing production, running evals, and catching regressions before they reach users. Braintrust Data,

  • Eden AI

    Access 500+ LLMs and expert AI models through one unified API. Route requests by cost, performance, and region with built-in smart routing and fallbacks. Eden AI publishes Eden AI

  • Hugging Face

    Hugging Face operates a model hub, inference tooling and collaboration products for machine-learning teams. Public pages cover hosting, inference endpoints and open-model distribut

  • Martian

    Martian markets model routing to automatically select cost/quality-optimal models for LLM requests. Public marketing also emphasises automated model routing specialty. It is presen

  • Maxim AI

    The fastest, most resilient, enterprise-grade LLM, MCP, and agent gateway. Routing, governance, guardrails, and observability via one control plane. Maxim AI publishes Bifrost AI G

  • Not Diamond

    Not Diamond provides LLM routing and evaluation to send each prompt to the best-performing model. Public marketing also emphasises router + eval framing for multi-model stacks. It

  • OpenRouter

    Find the best models & prices for your prompts. OpenRouter is used for Model routing and Model hosting / inference work. OpenRouter is recorded in New York, United States. OpenRout

  • Portkey

    Democratize and productionize Gen AI across your entire org with Portkey. Portkey publishes Portkey AI Gateway and Portkey MCP Gateway as named AI products. Portkey is used for AI

  • Requesty

    Route every LLM call through one OpenAI-compatible API. 600+ models from OpenAI, Anthropic, Google and more. Smart routing, caching, failover, observability, EU data residency and

  • Vercel

    Vercel publishes AI SDK, v0, and Vercel AI Gateway as named AI products. Vercel is used for AI SDKs and AI app builders work. Vercel is recorded in San Francisco, United States. Ve

Products

Claimed products appear first. Ranking packs and payment do not change this list.

Also used in this category

These products have a different primary category so they do not compete for the same ranking queries. They are listed here because buyers still encounter them in this job.

Related categories

Relevant procurement and assurance guides

Frequently asked questions

What is Model routing?

Choosing which model handles a request for quality, cost or latency. Jobs: quality-based routing; cost-aware fallbacks; a/b between models.

What should not be listed as Model routing?

Products whose buyer job is gateways, hosting, or token-cost dashboards without routing logic. Those belong on their own category page so search queries are not split.

Has AI Trustmark independently assessed every Model routing supplier?

No. A category listing is descriptive. Independent assessment is shown only on company or product pages that carry Trustmark evidence.

What model or provider changes should a buyer insist on being told about?

Material change usually includes a new model family, new region, new subprocessor, new write-capable tool, or a change that affects logging, privacy or human oversight. Those changes should trigger evidence refresh rather than a silent release.

How should buyers verify where AI customer data is processed?

Ask for the named processing locations, cloud regions and any subprocessors that see prompts, files or outputs. A directory listing is not evidence of residency. Independent assessment records the locations that were in scope on the assessment date.

Does a TrustMark on one product cover the rest of the company?

No. Independent assessment is scoped to the named organisation and, where relevant, the named product. Category pages list suppliers as a topic label. They do not imply that every listed company has been assessed.

What incident-handling evidence is useful for AI suppliers?

Buyers should see how AI-specific failures are detected, contained and notified — including unsafe outputs, data leakage and unauthorised agent actions. An incident policy that never mentions models, prompts or tools is incomplete for this class of product.

What security testing evidence should buyers request for an AI product?

Ask what was tested, against which version, whether prompt-injection, data-exfiltration and tenant isolation were in scope, and where failed prompts were stored. A generic ISO certificate or a vendor scanner screenshot is not by itself an AI TrustMark assessment.