Not Diamond vs TrueFoundry

Both are llm gateways tools. Here is how they actually differ on price, billing model and deployment.

Not Diamond TrueFoundry
Category LLM Gateways LLM Gateways
Our rating 4/5 4/5
Starting price Conflicting reports $499/mo
Billing meter No usage metering request
Free plan Yes Yes
Free self-hosting No or paid tier only No or paid tier only
Best for Teams already running a gateway who want smarter per-request model selection without putting another vendor in the request path, particularly for coding agents where model spend is high and uncontrolled. Enterprises that need an AI gateway deployable on-premise or in their own cloud with governance features, and that want a managed product rather than operating open-source infrastructure.

Our verdict on Not Diamond

Not Diamond is architecturally the most interesting thing in this category because it declines to be a gateway. Integrations are stack-agnostic through its API, and recommendations are executed in your own model gateway and harness - so it tells you which model to call and gets out of the way. Every other router in this category is a proxy, which means adopting it creates a request-path dependency and a new availability risk. Not Diamond has neither. It composes with LiteLLM, Vercel, Cloudflare or your own proxy rather than replacing any of them, which makes it unusually low-commitment to try. The product is a pre-trained Chat router, a Code router aimed at coding-agent cost currently in early access, and custom routers trained on your own data. That last one matters most, because the weakness of generic routing is that your workload is not the benchmark it was tuned on. The unsatisfying part is pricing, where sources directly contradict each other, and the fact that the most differentiated capability is still early access.

Full Not Diamond review →

Our verdict on TrueFoundry

TrueFoundry is a credible enterprise AI gateway with one capability that genuinely distinguishes it - it deploys on-premise and in your own cloud, not just as SaaS. For regulated organisations that cannot route prompts through a third party but also do not want to own an open-source proxy outright, that middle position is valuable and few competitors occupy it. Native MCP support and semantic caching are both ahead of most of the field, and the free Developer tier at 50,000 requests a month is a real trial. The company looks solid, having raised over $21 million from Intel Capital, Eniac Ventures and Peak XV, appeared in Gartner's 2026 Hype Cycle for Platform Engineering, and acquired Seldon AI. One thing worth knowing as a reader rather than a buyer. TrueFoundry publishes detailed pricing guides for LiteLLM, Portkey, LangChain and others, and those articles rank well for competitor searches. They are reasonable content, but they are competitor marketing, and if you have been researching gateway pricing you have probably read several without noticing whose site you were on.

Full TrueFoundry review →
These two meter differently, so published prices are not comparable. Model both against your own workload →

Frequently Asked Questions

What is the main difference between Not Diamond and TrueFoundry?

Not Diamond: Teams already running a gateway who want smarter per-request model selection without putting another vendor in the request path, particularly for coding agents where model spend is high and uncontrolled. TrueFoundry: Enterprises that need an AI gateway deployable on-premise or in their own cloud with governance features, and that want a managed product rather than operating open-source infrastructure. Both sit in LLM Gateways, so the decision usually comes down to billing model and deployment rather than raw capability.

Which is cheaper, Not Diamond or TrueFoundry?

It depends entirely on your workload shape, because they meter differently - Not Diamond bills on no usage metering and TrueFoundry bills on request. Published starting prices are Conflicting reports and $499/mo respectively, but those numbers are not comparable until you apply them to the same traffic. Use our cost calculator to model both against your own request volume and span count.

Can I self-host Not Diamond or TrueFoundry?

Not Diamond: No or paid tier only. TrueFoundry: No or paid tier only. Free self-hosting means no licence fee, not no cost - you still own the infrastructure, upgrades and on-call.