CI configuration: what AI coding agents learn from your pipeline
This check looks for a CI pipeline defined in the repo: GitHub Actions workflows, or another CI system's config file.
How many repos have CI?
Of the 401 repos on the leaderboard, 383 pass in full (96%), 8 pass in part (2%) and 10 fail (2%).
Why do AI coding agents need CI?
A CI config records how the project is built and tested. An agent reads it to learn which commands a change must pass, and runs them before opening a pull request.
What counts as CI configuration?
- Full pass: at least one
.ymlor.yamlfile in.github/workflows/. - 90%: a config for GitLab CI, CircleCI, Azure Pipelines, Travis CI, Jenkins or Buildkite.
- Fail: none of these. We do not check what the pipeline runs.
How checks become a score: methodology.
How do I add CI to my repo?
Add a workflow that runs the tests and the linter on every pull request, with the same commands you document for local use.
Which AI coding agents weigh CI most?
- OpenHands10% of its score
- Codex9% of its score
- Devin8% of its score
- Claude Code7% of its score
- Gemini CLI7% of its score
- Pi5% of its score
- Kimi Code CLI5% of its score
- Cursor5% of its score
- Aider4% of its score
Pass rate by language
- Rust45 of 45 (100%)
- Java28 of 28 (100%)
- JavaScript15 of 15 (100%)
- PHP12 of 12 (100%)
- C#8 of 8 (100%)
- Dart7 of 7 (100%)
- Elixir7 of 7 (100%)
- Haskell7 of 7 (100%)
- Scala6 of 6 (100%)
- Clojure5 of 5 (100%)
- TypeScript81 of 82 (99%)
- Python53 of 56 (95%)
- C++19 of 21 (90%)
- C9 of 10 (90%)
- Ruby9 of 10 (90%)
- Go35 of 40 (88%)
- Kotlin10 of 12 (83%)
- Zig5 of 6 (83%)
- Swift8 of 10 (80%)
Top-scoring repos that pass
- Rust · 6.8k ★
- Ruby · 48.1k ★
- pingcap/tidb89.6Go · 40.7k ★
- apache/superset88.7Python · 75.4k ★
- axios/axios88.1JavaScript · 109.3k ★
- aio-libs/aiohttp88.1Python · 16.6k ★
- PostHog/posthog88.0Python · 40.7k ★
- C++ · 133.6k ★
- Python · 46.3k ★
- Rust · 33.3k ★
- TypeScript · 115 ★
- TypeScript · 2 ★(this site's own repo)
Popular repos that fail it
- golang/go29.9Go · 139.8k ★
- Go · 128.9k ★
- swiftlang/swift47.9Swift · 70.5k ★
- karpathy/nanoGPT18.2Python · 64.5k ★
- Python · 60.3k ★
- ziglang/zig35.9Zig · 43.3k ★
- Kotlin · 13.8k ★
- farzaa/clicky28.2Swift · 8k ★
Every check, grouped into what to do first: how to make your repo ready for AI coding agents.