Cloudflare AI Gateway vs TrueFoundry

Both are llm gateways tools. Here is how they actually differ on price, billing model and deployment.

Cloudflare AI Gateway TrueFoundry
Category LLM Gateways LLM Gateways
Our rating 4/5 4/5
Starting price $0 $499/mo
Billing meter record request
Free plan Yes Yes
Free self-hosting No or paid tier only No or paid tier only
Best for Teams already on Cloudflare who want caching, rate limiting and cost visibility at the edge with no markup, and who have separate tooling for evaluation. Enterprises that need an AI gateway deployable on-premise or in their own cloud with governance features, and that want a managed product rather than operating open-source infrastructure.

Our verdict on Cloudflare AI Gateway

Cloudflare AI Gateway is the best free managed gateway available, and the reason is that Cloudflare is not trying to make money from it directly. Core features - dashboard analytics, caching, rate limiting - are free on every plan, there is no percentage markup on your tokens, and the free tier includes 100,000 logs a month with the $5 Workers Paid plan lifting that to a million. Compare OpenRouter charging 5.5% of everything you spend forever, and the difference at volume is substantial. Running at the edge is a genuine architectural advantage too, putting the control plane near your users rather than in one region. The 2026 addition of unified billing, letting you pay for OpenAI, Anthropic and Google AI Studio usage through a single Cloudflare invoice, removes procurement friction that is more annoying in practice than it sounds. Two honest limits. The metering is logs, not requests, so that is the number to model. And observability stops at request metrics and cost - there is no structured evaluation, so this is one component of a stack rather than the stack.

Full Cloudflare AI Gateway review →

Our verdict on TrueFoundry

TrueFoundry is a credible enterprise AI gateway with one capability that genuinely distinguishes it - it deploys on-premise and in your own cloud, not just as SaaS. For regulated organisations that cannot route prompts through a third party but also do not want to own an open-source proxy outright, that middle position is valuable and few competitors occupy it. Native MCP support and semantic caching are both ahead of most of the field, and the free Developer tier at 50,000 requests a month is a real trial. The company looks solid, having raised over $21 million from Intel Capital, Eniac Ventures and Peak XV, appeared in Gartner's 2026 Hype Cycle for Platform Engineering, and acquired Seldon AI. One thing worth knowing as a reader rather than a buyer. TrueFoundry publishes detailed pricing guides for LiteLLM, Portkey, LangChain and others, and those articles rank well for competitor searches. They are reasonable content, but they are competitor marketing, and if you have been researching gateway pricing you have probably read several without noticing whose site you were on.

Full TrueFoundry review →
These two meter differently, so published prices are not comparable. Model both against your own workload →

Frequently Asked Questions

What is the main difference between Cloudflare AI Gateway and TrueFoundry?

Cloudflare AI Gateway: Teams already on Cloudflare who want caching, rate limiting and cost visibility at the edge with no markup, and who have separate tooling for evaluation. TrueFoundry: Enterprises that need an AI gateway deployable on-premise or in their own cloud with governance features, and that want a managed product rather than operating open-source infrastructure. Both sit in LLM Gateways, so the decision usually comes down to billing model and deployment rather than raw capability.

Which is cheaper, Cloudflare AI Gateway or TrueFoundry?

It depends entirely on your workload shape, because they meter differently - Cloudflare AI Gateway bills on record and TrueFoundry bills on request. Published starting prices are $0 and $499/mo respectively, but those numbers are not comparable until you apply them to the same traffic. Use our cost calculator to model both against your own request volume and span count.

Can I self-host Cloudflare AI Gateway or TrueFoundry?

Cloudflare AI Gateway: No or paid tier only. TrueFoundry: No or paid tier only. Free self-hosting means no licence fee, not no cost - you still own the infrastructure, upgrades and on-call.