Research
Harvey open-sources a synthetic law firm knowledge expansion of its Legal Agent Benchmark
On August 7, 2026 Harvey announced that it is open-sourcing an expansion of LAB, its Legal Agent Benchmark: a synthetic law firm called Calderwood & Harkness whose files cover 266 matters for 46 fictional clients across 15 practice areas. The expansion has 250 tasks that test retrieval and reasoning over the firm's documents, and an LLM judge scores each task against a per-task rubric. The tasks are published in the harveyai/harvey-labs repository on GitHub. USASI has not run the benchmark.1
Related catalog entries
Sources
Share or cite this page
- X (opens X)
- Bluesky (opens Bluesky)
- LinkedIn (opens LinkedIn)
- Reddit (opens Reddit)
- Hacker News (opens Hacker News)
- Email (opens your email app)
- RSS updates
Cite this page
APA style
USASI. (2026, October 13). Harvey open-sources a synthetic law firm knowledge expansion of its Legal Agent Benchmark. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/news/harvey-open-sources-lab-law-firm-knowledge-tasks/
BibTeX
@misc{usasi_news_harvey_open_sources_lab_law_firm_knowledge_tasks,
author = {{USASI}},
title = {Harvey open-sources a synthetic law firm knowledge expansion of its Legal Agent Benchmark},
year = {2026},
month = oct,
howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/news/harvey-open-sources-lab-law-firm-knowledge-tasks/}},
note = {United States of America Superintelligence. Last updated 2026-10-13}
}The date is when this page was last updated. Add the date you read it if your style needs one.