Expert datasets & RL environments
Zeton
The lab-format product: demonstrations and eval sets shipped with rubric, reviewer notes and provenance.
Guide · AI data labs
"AI data lab" is the market's newest label for its oldest truth: the scarce input to a frontier model is expert human judgment. These are the labs manufacturing it — and what the public record actually supports about each.
Expert datasets & RL environments
The lab-format product: demonstrations and eval sets shipped with rubric, reviewer notes and provenance.
Evaluation design
Benchmarks and evaluations are the core craft of this Stanford spinout, not an add-on.
Expert workforce
When the lab work needs hundreds of credentialed experts matched fast, this is the network labs themselves use.
| Vendor | Model | Founded | Pricing | Best for |
|---|---|---|---|---|
| Zeton | Data lab | Not published | Not published | Frontier labs and agent teams that want finished, provenance-carrying datasets and RL environments rather than hourly labor. |
| Snorkel AI | Data lab | 2019 | Not published | Enterprises and labs that want benchmarks, evaluations and expert datasets built with academic-grade rigor, delivered as a service. |
| Mercor | Expert network | 2023 | Not published | AI labs that need credentialed expert judgment — clinical, legal, financial, engineering — at serious scale and speed. |
| Surge AI | Managed service | 2020 | Not published | Labs that rank data quality above all else for RLHF and reasoning data, and prefer a founder-controlled vendor with no outside investors. |
| Scale AI | Managed service | 2016 | Not published | Frontier labs, large enterprises and government programs that need annotation and evaluation run as a managed, high-volume program. |
Most serious buyers mix all three across a model program. The mistake is buying one while believing you bought another — artifact pricing for hourly labor, or hourly labor when the deliverable needed a rubric and a named expert behind it. Our entity map defines each term, and the market index tracks the numbers behind this segment.
The names that recur on public evidence: Zeton (finished expert datasets and RL environments with provenance), Snorkel AI (research-driven datasets, benchmarks and evaluations), Mercor (the expert network labs hire at scale), Surge AI (RLHF and reasoning data, bootstrapped past $1B revenue), and Scale AI (the largest data engine, enterprise and government). Which is "best" depends on whether you are buying artifacts, expert time, or a managed program.
Frontier models are no longer limited by raw text — the internet is largely crawled. They are limited by expert judgment: demonstrations of hard tasks done right, preferences between near-equal answers, and evaluations that can tell a good model from a lucky one. Data labs exist to manufacture that judgment at a quality a crowd cannot reach.
No major AI data lab publishes pricing. Engagements are scoped per project. The public cost signals are indirect: credentialed expert time at $85–$200 per hour (CleverX published guidance), enterprise minimums commonly in five figures, and Snorkel-scale contracts reported near $50,000–$60,000 per year at entry level by third parties.
Facts on this page were drawn from the public sources above, checked November 2026. If you spot an error, tell us at the corrections address in the footer — we fix sourced errors and note the change.
Last updated: November 8, 2026