← all checks

CI configuration: what AI coding agents learn from your pipeline

This check looks for a continuous integration pipeline defined in the repo: GitHub Actions workflows, or a config file for another CI system.

How many repos pass

Of the 371 repos on the leaderboard, 354 pass in full (95%), 8 pass in part (2%) and 9 fail (2%).

Why agents need it

A CI config is a written record of how the project is built and tested. An agent can read it to learn which commands a change has to pass and run them before opening a pull request.

How we score it

  • Full pass: at least one .yml or .yaml file in .github/workflows/.
  • 90%: a config for GitLab CI, CircleCI, Azure Pipelines, Travis CI, Jenkins or Buildkite.
  • Fail: none of these. We do not check what the pipeline runs.

The methodology has the formula that turns checks into a score.

How to pass

Add a workflow that runs the tests and the linter on every pull request. Use the same commands you document for local use, so an agent can run them before it pushes.

Which agents count it most

Pass rate by language

Top-scoring repos that pass

Popular repos that fail it