.openhands/setup.sh: the setup script OpenHands runs
.openhands/setup.sh is a shell script that OpenHands runs when a session starts. It is where a repo installs its dependencies and prepares anything the tests need.
How many repos pass
Of the 371 repos on the leaderboard, 2 pass in full (0.5%), 0 pass in part (0%) and 369 fail (99%).
Why agents need it
OpenHands works inside a sandboxed container, and its repo-customization docs say it runs this script at session start. With it, the agent begins with a working environment. Without it, the agent spends its first steps working out how to install the project. Only OpenHands reads it, so this check only affects the OpenHands score.
How we score it
- Full pass:
.openhands/setup.shexists and is not empty. - 20%: the file exists but is empty.
- Fail: no
.openhands/setup.sh.
The methodology has the formula that turns checks into a score.
How to pass
Add .openhands/setup.sh with the commands a new contributor runs once: install dependencies, build what needs building, set up test fixtures. Keep it non-interactive, since nobody is there to answer a prompt.
Which agents count it most
- OpenHands10% of its score
Pass rate by language
Top-scoring repos that pass
- TypeScript · 90.8k ★
- hsnice16/tula78.1TypeScript · 0 ★
Popular repos that fail it
- TypeScript · 391.8k ★
- react/react66.9JavaScript · 250.9k ★
- TypeScript · 213k ★
- n8n-io/n8n83.4TypeScript · 207.1k ★
- microsoft/vscode71.3TypeScript · 193.6k ★
- TypeScript · 190.9k ★
- Python · 187.5k ★
- ollama/ollama80.0Go · 182.9k ★