Harvey LAB

What it is

Harvey LAB is a benchmark of about 2,000 legal tasks spanning 24 practice areas plus contracting, each with instructions, source documents, and grading rubrics. It ships an execution harness and grader, also installable as a Python package, that run agents in a sandbox, score their output with all-pass rubrics and an LLM judge, and produce reports and comparison dashboards. Researchers and legal AI teams use it to measure how well agents handle realistic assignments such as M&A data-room review.