Privacy and advertising choices
Git-Stars uses essential storage for site operation. Optional analytics and ad-measurement scripts stay disabled unless you accept them; partners such as Google may then use cookies or similar identifiers where required. Privacy Policy
A benchmark built to evaluate and improve agent capabilities for supporting legal work.
This repository page has enough original analysis, source evidence, and comparison context to be treated as an indexable Git-Stars review.
100
review score
Problem solved
It addresses the lack of standardized, realistic benchmarks for legal AI agents, which often rely on generic QA datasets or proprietary evaluations. By providing a domain-specific, task-based benchmark with rubrics and an execution harness, it enables objective, reproducible assessment of agent performance on complex legal workflows, facilitating targeted improvements and fair comparisons across models and frameworks.
Deployment reality
The available setup signal starts with: Start with the full walkthrough in docs/tutorial.md. Treat this as a starting point, then ask Codex or Claude to inspect the README, environment variables, runtime version, and deployment target before production use.
Commercial use
The recorded license is MIT. This is a useful commercial-use signal, but teams should still verify license text, dependencies, model/API terms, and trademark constraints.
Capability ceiling
Developers can build and evaluate AI agents that perform legal tasks such as M&A data-room analysis, contract review, legal research, and drafting, using the provided tasks and harness. The benchmark supports custom task creation, model adapters, and evaluation sweeps, allowing teams to measure agent performance, identify weaknesses, and iterate on agent designs. The ceiling includes achieving human-level or superhuman performance on specific legal workflows, with the potential to drive adoption of AI in legal practice by demonstrating reliability and quality.
Git-Stars is independent and not affiliated with GitHub or this project. Analysis may be AI-assisted and based on public repository metadata plus short README-derived summaries. We do not mirror full README files, docs, issues, or social comments.
harveyai/harvey-labs is tracked as a Python project in the AI Agent, LLM Tool, UI Framework area. This evaluation combines public GitHub metadata, category signals, short source summaries, and Git-Stars editorial rules rather than copying project documentation.
Momentum check: the repository has 1.2k total stars, with +0 today, +567 this week, and +0 this month. These growth windows help distinguish durable adoption from short-lived visibility spikes.
Maintenance check: current activity is Active; the latest push was 11 days ago, and the open issue queue is 51, about 4.20% of total stars. Treat this as an adoption signal, not a substitute for engineering due diligence.
Adoption check: 209 forks and 1.2k watchers suggest how often the project is reused or followed. License signal: MIT. Always verify license compatibility before commercial or internal use.
Practical fit: this project is most relevant when you need Python teams evaluating ecosystem-native tooling. Be cautious when you need a legal review, security audit, or production SLA.
Source check: Git-Stars currently has 2 explicit source reference(s) for this report and a recent growth signal of 567. Follow the original GitHub repository for final install, security, and release information.
Analysis
ReadyOriginal problem, capability, and verdict guidance are available.
Sources
ReadyRepository metadata and README/source references are attached.
License
ReadyMIT is recorded for review.
Maintenance
ReadyRecent activity is visible in repository metadata.
Alternatives
ReadyEnough nearby projects exist for comparison.
Momentum
1.2k Stars
Reuse
209 Forks
Attention
1.2k Watchers
Maintenance
active
License
MIT
Open issues
51
Harvey LAB is an open-source benchmark for evaluating LLM agents on realistic legal work. It includes a dataset of tasks with instructions, documents, and rubrics, plus an execution harness for running and scoring agents.
Key Features
- Dataset of 1671 tasks across 24+ legal practice areas and contracting - Execution harness with tools, adapters, reports, and sweeps - All-pass rubric scoring and LLM judge evaluation methodology
AI Agent
Agent frameworks, autonomous workflows, and tool-use systems
LLM Tool
Libraries and tools for LLM apps, RAG, prompts, and evals
UI Framework
Frontend frameworks, design systems, and interface libraries
Start with the full walkthrough in docs/tutorial.md73
Health Score
Active
Commit Activity
Mar 30, 2026
Created
Aug 12, 2026
Last push
+3
Today's growth
+394
7-day growth
+394
30-day growth
Forks
Open
Watchers
harveyai
GitHub profilecodecrafters-io/build-your-own-x
Master programming by recreating your favorite technologies from scratch.
sindresorhus/awesome
😎 Awesome lists about all kinds of interesting topics
freeCodeCamp/freeCodeCamp
freeCodeCamp.org's open-source codebase and curriculum. Learn math, programming, and computer science for free.
EbookFoundation/free-programming-books
:books: Freely available programming books
nilbuild/developer-roadmap
Interactive roadmaps, guides and other educational content to help developers grow in their careers.
✓
License
✓
Forked
✓ Active
Maintained
Problem Solved
It addresses the lack of standardized, realistic benchmarks for legal AI agents, which often rely on generic QA datasets or proprietary evaluations. By providing a domain-specific, task-based benchmark with rubrics and an execution harness, it enables objective, reproducible assessment of agent performance on complex legal workflows, facilitating targeted improvements and fair comparisons across models and frameworks.
Capabilities
Developers can build and evaluate AI agents that perform legal tasks such as M&A data-room analysis, contract review, legal research, and drafting, using the provided tasks and harness. The benchmark supports custom task creation, model adapters, and evaluation sweeps, allowing teams to measure agent performance, identify weaknesses, and iterate on agent designs. The ceiling includes achieving human-level or superhuman performance on specific legal workflows, with the potential to drive adoption of AI in legal practice by demonstrating reliability and quality.
Bottom Line
Harvey LAB is a valuable resource for AI researchers, legal tech developers, and law firms seeking to rigorously evaluate and improve AI agents for legal work. It is not suitable for those looking for a plug-and-play legal AI solution or for non-technical legal professionals without engineering support. The key trade-off is the significant effort required to set up and run the benchmark versus the benefit of obtaining domain-specific, actionable performance insights.