Dependency manifests: letting AI coding agents rebuild your environment
This check looks for a file that lists the project's dependencies in a form a package manager can read: package.json, pyproject.toml, Cargo.toml, go.mod, pom.xml and the equivalents for other languages.
How many repos pass
Of the 371 repos on the leaderboard, 341 pass in full (92%), 0 pass in part (0%) and 30 fail (8%).
Why agents need it
An agent that works in a fresh sandbox has to install everything before it can run a single test. A manifest makes that one command. Without one, the agent infers dependencies from import statements and gets versions wrong.
How we score it
- Full pass: a manifest or lockfile at the repo root.
- Fail: none found. A lockfile is not required to pass.
The methodology has the formula that turns checks into a score.
How to pass
Commit the manifest your package manager expects at the repo root, and commit the lockfile with it so an agent installs the same versions you do.
Which agents count it most
- Devin12% of its score
- OpenHands10% of its score
- Aider10% of its score
- Pi10% of its score
- Kimi CLI10% of its score
- Cursor10% of its score
- GPT-5 Codex9% of its score
- Claude Code9% of its score
- Gemini CLI9% of its score
Pass rate by language
Top-scoring repos that pass
- Rust · 33.1k ★
- gitlab-org/cli92.7— · 1.1k ★
- apache/superset92.2Python · 75.1k ★
- axios/axios91.9JavaScript · 109.4k ★
- aio-libs/aiohttp91.9Python · 16.6k ★
- C++ · 131k ★
- Rust · 6.7k ★
- TypeScript · 115 ★
- TypeScript · 2 ★
- Python · 46k ★
- scrapy/scrapy90.6Python · 64.8k ★
- Clojure · 49.6k ★
Popular repos that fail it
- TypeScript · 190.9k ★
- Python · 187.5k ★
- TypeScript · 150.4k ★
- Python · 147.7k ★
- golang/go31.2Go · 139.2k ★
- python/cpython63.2Python · 77.6k ★
- redis/redis48.5C · 76.8k ★
- ocornut/imgui22.1C++ · 76.6k ★