Gentrace logo

Gentrace Review (2026)

An LLM testing and evaluation platform that has shut down. The company's own site confirms it, and the code was released on GitHub under MIT. Do not adopt.

Researched

Rating

1.0

Starting Price

Discontinued

Free Plan

No

SDKs & Frameworks

3

Deployment

2

Best For

Nobody. The company has shut down. Existing users should migrate to Braintrust, promptfoo or DeepEval.

Last Updated:

10 Things You Should Know About Gentrace

  1. 1 Gentrace's own site states that the company has shut down
  2. 2 The platform is no longer available
  3. 3 The code was released on GitHub under the MIT license
  4. 4 No specific shutdown date is published on the site
  5. 5 No vendor-provided migration path to a successor product was published

Pros & Cons

Pros

  • The source was released under MIT rather than abandoned as a closed binary, which is a genuinely decent exit
  • MIT is more permissive than the Elastic or AGPL licenses some living competitors use
  • The CI-first framing was a sound idea and worth carrying into whatever you choose instead

Cons

  • The company has shut down and the hosted platform is gone
  • No maintainer, no support, no security patches and no roadmap
  • Adopting the released code means owning an orphaned evaluation platform outright
  • No vendor-provided migration path to any successor
  • Every integration will drift as provider APIs change, with nobody to fix it

Features

Evaluation and testing for LLM applications with a CI-first workflow
Dataset management and test case organisation
Human grading and review workflows
Experiment comparison across prompt and model versions

Gentrace has shut down

Short page, because there is not much to evaluate.

Gentrace’s own site states that the company has shut down and the product is no longer available. The code has been released on GitHub under the MIT license.

If you are comparing LLM evaluation platforms, remove it from the list. If you are already on it, you have presumably already found out.

We could not find a specific shutdown date published. If you need one for contractual or audit reasons, your own account records are the only reliable source.

The exit was handled decently

Worth acknowledging, because not every vendor does this.

Releasing under MIT is genuinely generous. It is more permissive than the Elastic License 2.0 that Arize Phoenix uses or the AGPL-3.0 on Langtrace’s server - you can fork it, modify it, run it commercially and relicense derivatives with essentially no obligations.

Compare the alternatives. Literal AI kept only a storage Data Layer and took the dashboards, evals and Playground with it. Humanloop simply switched off. Gentrace handed over the whole thing with no strings.

But released code is not a platform

The distinction matters and it is easy to blur when something is free.

There is no maintainer, no security process and no roadmap. In this category that decays faster than most. Provider APIs change, model identifiers change, SDK interfaces change, and every one of those is an integration that breaks with nobody assigned to fix it.

Adopting the Gentrace source means you now own an evaluation platform. For a team with engineers who can genuinely take that on and a strong reason to prefer this codebase, it is a legitimate choice. For everyone else the maintenance cost will exceed what a living competitor charges within a year.

The idea worth keeping

Gentrace’s framing was sound, and it is worth carrying forward as a requirement rather than losing with the company.

It treated LLM evaluation as part of the test pipeline rather than as a dashboard you visit occasionally. Datasets, test cases and experiment comparison wired into CI, so a quality regression blocks a deploy the way a failing unit test does.

A surprising number of evaluation platforms are analysis tools first and make release gating awkward. When you shortlist a replacement, make CI integration an explicit criterion and ask to see it working.

What to use instead

  • Braintrust - the closest commercial equivalent for dataset-driven evaluation and regression testing as a managed product.
  • promptfoo - the strongest open-source option for the CI-first workflow specifically; it is built around running evals as tests.
  • DeepEval - the other serious open-source choice, and it pairs cleanly with a CI pipeline.

All three are actively maintained with real communities, which is precisely what Gentrace can no longer offer at any price.

A pattern worth noticing

We are not going to speculate about any individual company’s finances. But we now maintain pages for Gentrace, Literal AI and WhyLabs, all shut down; Humanloop, acqui-hired and wound down; and Helicone and Traceloop, absorbed into larger platforms. That is significant turnover inside eighteen months, and it should shape how you buy rather than just what you buy.

The practical defence is portability. Prefer permissive licenses, OpenTelemetry-based tracing and open evaluation formats. If your instrumentation is standard and your eval datasets are yours, a vendor failure costs you a migration. If they are not, it costs you a rewrite.


Shutdown confirmed against Gentrace’s own site on 31 July 2026. No specific discontinuation date is published. This is a researched directory entry - we have not instrumented this platform, and given it is shut down, we will not.

Pricing Plans

Hosted platform (Discontinued)

Unavailable

  • Company has shut down
  • Platform no longer available
  • No new signups
Most Popular

Released source

$0

  • Code released on GitHub under the MIT license
  • No maintainer, no support, no roadmap
  • You would own it entirely

SDKs & Frameworks

Python SDK (legacy) TypeScript SDK (legacy) OpenAI and other provider integrations

Deployment

Hosted platform discontinued Source available on GitHub under MIT

Eval Methods

Dataset-driven evaluation CI/CD test integration Human grading workflows

Status

Shut down

Our Verdict

Gentrace has shut down. The company's own site states it plainly, and the code has been released on GitHub under the MIT license. As exits go this is a reasonable one - MIT is genuinely permissive, more so than the Elastic License that Arize Phoenix uses or the AGPL on Langtrace's server, so anyone who wants to fork it and carry on legally can. But a released codebase is not a platform. There is no maintainer, no security process and no one to fix the integrations as provider APIs shift underneath them, which in this category happens constantly. The CI-first approach Gentrace took was a good idea and worth keeping as a requirement when you pick a replacement. The software itself is now a project you would be adopting, not a product you can buy. We rate it 1 because the only useful thing this page can do is stop you evaluating it.

Similar Tools

Frequently Asked Questions

Is Gentrace really shut down?

Yes, and it comes from the company itself. Gentrace's own site states that the company has shut down and the product is no longer available. This is about as unambiguous as a status signal gets - it is not an inference from stale comparison pages or a quiet repository. We could not find a specific shutdown date published on the site, so if you need one for contractual or audit purposes you will need your own account records.

Can I self-host the released code?

Legally yes, practically think hard. The code was released on GitHub under the MIT license, which is genuinely permissive - you can fork it, modify it, run it commercially and relicense derivatives with essentially no obligations. That is a better outcome than a closed-source shutdown. But you would be adopting an orphaned evaluation platform. Nobody is maintaining it, nobody is patching security issues, and in this category provider APIs and model interfaces change constantly, so integrations rot quickly. Unless you have engineers who can genuinely own it, the maintenance cost will exceed what a live competitor charges.

What was good about it worth keeping?

The CI-first framing. Gentrace treated LLM evaluation as something that belongs in your test pipeline rather than in a dashboard you visit occasionally - datasets, test cases and experiment comparison wired into continuous integration. That is the right instinct, and it is worth carrying into your replacement search as an explicit requirement rather than a nice-to-have. A surprising number of evaluation platforms are analysis tools that make release gating awkward.

What should I migrate to?

Braintrust is the closest commercial equivalent if you want dataset-driven evaluation and regression testing as a managed product. promptfoo is the strongest open-source option if you want the CI-first workflow specifically, since it is designed around running evals as tests. DeepEval is the other serious open-source choice and pairs well with a CI pipeline. All three are actively maintained with real communities behind them, which is the thing Gentrace can no longer offer at any price.

Why does this keep happening in this category?

We are not going to speculate about any individual company's finances, but the pattern is worth naming because it should shape how you buy. Gentrace, Literal AI and WhyLabs have all shut down, Humanloop was acqui-hired and wound down, and Helicone and Traceloop were acquired into larger platforms. That is a lot of turnover in eighteen months. The practical defence is to prefer tools with permissive licenses and portable data - OpenTelemetry-based tracing and open eval formats mean a vendor failure costs you a migration rather than a rewrite.