Agent Friendly Code
← all checks

Reproducible dev environments: one-command setup for AI coding agents

This check looks for files that set up the project with one command: a Makefile, a devcontainer, a Dockerfile or compose file, Nix files, a justfile, a Taskfile, tox.ini, noxfile.py, the Maven or Gradle wrapper, or bin/setup.

How many repos pass

Of the 371 repos on the leaderboard, 79 pass in full (21%), 192 pass in part (52%) and 100 fail (27%).

Why agents need it

Agents that run in their own machine have to get the project working there first. Devin starts from a virtual machine with the repo, its tools and its dependencies already set up, per Cognition's environment docs, so its profile weighs a runnable environment above CI. A setup that is written down as a file is one an agent can run.

How we score it

  • Full pass: two or more of these files.
  • 70%: exactly one.
  • 60%: none, but package.json defines three or more scripts.
  • Fail: none of the above. We do not check that the setup works.

The methodology has the formula that turns checks into a score.

How to pass

Add a Makefile or justfile with setup, test and lint targets, and a devcontainer or Dockerfile that installs the toolchain. Two of these files earn the full pass.

Which agents count it most

Pass rate by language

Top-scoring repos that pass

Popular repos that fail it