Verified-professional depth
CleverX
Government-ID and licence-verified experts for high-stakes evaluation, with published rate guidance.
Guide · Companies
Ten companies define this market — four different business models wearing one label. This is the complete comparison: what each sells, what each charges when they will say, and who each one is quietly wrong for.
| Vendor | Model | Founded | Pricing | Best for |
|---|---|---|---|---|
| Scale AI | Managed service | 2016 | Not published | Frontier labs, large enterprises and government programs that need annotation and evaluation run as a managed, high-volume program. |
| Surge AI | Managed service | 2020 | Not published | Labs that rank data quality above all else for RLHF and reasoning data, and prefer a founder-controlled vendor with no outside investors. |
| Mercor | Expert network | 2023 | Not published | AI labs that need credentialed expert judgment — clinical, legal, financial, engineering — at serious scale and speed. |
| Appen | Managed service | 1996 | Not published | Multilingual and speech/audio data at global scale, and buyers who value a vendor with public financial reporting and a 30-year operating history. |
| Micro1 | Expert network | 2022 | Not published | Companies that want vetted expert capacity without running their own recruiting funnel, and experts who want clearly posted pay ranges before they apply. |
| Labelbox | Platform | 2018 | Published — Free tier (500 LBU/mo); Starter $0.10 per LBU; Enterprise custom | ML teams that want to own their annotation workflow on a platform with transparent usage pricing, with expert services available as an add-on. |
| Snorkel AI | Data lab | 2019 | Not published | Enterprises and labs that want benchmarks, evaluations and expert datasets built with academic-grade rigor, delivered as a service. |
| Zeton | Data lab | Not published | Not published | Frontier labs and agent teams that want finished, provenance-carrying datasets and RL environments rather than hourly labor. |
| Prolific | Platform | 2014 | Published — you set participant pay (min $8/hr, $12/hr recommended) + 42.8% corporate platform fee | Evaluation studies, preference data and research panels where you want a representative, verified population today, with pricing you can read before talking to anyone. |
| CleverX | Expert network | Not published | Expert-data rates published as guidance ($85–$200/hr typical); platform Pro $149/user/mo + credits | High-stakes evaluation, rubrics and demonstrations where the work must trace back to a genuinely credentialed professional. |
Two columns do more work than the rest. Pricing: in a market where most vendors hide their prices, the ones who publish — Labelbox, Prolific, CleverX (guidance) — are making a statement about how they compete. Model: a platform and a managed service cannot be ranked against each other without lying to you, which is why this publication ranks within use cases instead of publishing one list to rule the category. Our homepage carries the per-use-case picks; the directory is the filterable version of this table.
Verified-professional depth
Government-ID and licence-verified experts for high-stakes evaluation, with published rate guidance.
Expert hiring, transparent pay
AI-interview vetting and per-role published pay ranges — the expert network a buyer can diligence from its own job board.
Research-grade datasets
The Stanford spinout for benchmarks, evaluations and expert data development as a service.
On public evidence: Scale AI (enterprise managed programs), Surge AI (RLHF quality), Mercor (expert data at scale), Appen (multilingual managed services), Micro1 (expert hiring with published pay ranges), Labelbox (platform), Snorkel AI (research-led data lab), Zeton (expert datasets and RL environments), Prolific (transparent self-serve human data) and CleverX (credential-verified experts). The best one is the one whose model matches your work — the table on this page is organized to make that call.
Choose the model before the brand: managed service if you want delivery owned end-to-end, expert network if the work needs credentialed judgment, platform if your team will run the annotation itself, data lab if you are buying finished datasets or evaluations. Then compare two or three vendors inside that model on artifacts, QA method and pricing transparency.
Very few. Labelbox publishes usage pricing ($0.10 per Labelbox Unit on Starter, with a free tier) and Prolific publishes its full model (participant pay from $8/hour plus a 42.8% corporate platform fee). CleverX publishes expert rate guidance ($85–$200/hour typical). Everyone else in this directory is quote-only.
One primary source per vendor shown; full source lists are on each profile.
Facts on this page were drawn from the public sources above, checked November 2026. If you spot an error, tell us at the corrections address in the footer — we fix sourced errors and note the change.
Last updated: November 8, 2026