← all checks

.openhands/setup.sh: the setup script OpenHands runs

.openhands/setup.sh is a shell script that OpenHands runs when a session starts. It is where a repo installs its dependencies and prepares anything the tests need.

How many repos pass

Of the 371 repos on the leaderboard, 2 pass in full (0.5%), 0 pass in part (0%) and 369 fail (99%).

Why agents need it

OpenHands works inside a sandboxed container, and its repo-customization docs say it runs this script at session start. With it, the agent begins with a working environment. Without it, the agent spends its first steps working out how to install the project. Only OpenHands reads it, so this check only affects the OpenHands score.

How we score it

  • Full pass: .openhands/setup.sh exists and is not empty.
  • 20%: the file exists but is empty.
  • Fail: no .openhands/setup.sh.

The methodology has the formula that turns checks into a score.

How to pass

Add .openhands/setup.sh with the commands a new contributor runs once: install dependencies, build what needs building, set up test fixtures. Keep it non-interactive, since nobody is there to answer a prompt.

Which agents count it most

Pass rate by language

Top-scoring repos that pass

Popular repos that fail it