Mercor Says 90% of US Work Hours Lack AI Benchmark Coverage
Summary
Mercor maps 29 AI benchmarks against 923 O*NET occupations and reports that only 208 have a task with at least 5 benchmark prompts. The company estimates 90% of American working hours go to tasks with little or no benchmark coverage, and 6 of 22 job families have none.
Key Points
- Mercor reports 924 of O*NET's 18,797 tasks are represented in its benchmark index.
- Mercor says O*NET tasks tagged AI-exposed are about six times more likely to appear on benchmarks than unexposed tasks.
- Mercor says its benchmarks heavily cover AI-exposed lawyers' tasks, but barely cover legal secretaries or court clerks.