← back to leaderboard

gitlab-org/gitlab-runnerGitLab

https://gitlab.com/gitlab-org/gitlab-runner
Stars:
2.6k
Default branch:
main
Last scored:
4h ago
Overall

Strengths

  • AGENTS.md / CLAUDE.md
  • CONTRIBUTING guide
  • Dependency manifest
  • Reproducible dev env
  • License file

Gaps

  • Pre-commit / git hooks

Suggestions to improve for a specific model

  1. 1
    Pre-commit / git hooks
    Set up pre-commit (.pre-commit-config.yaml), husky, or lefthook to run format+lint on every commit.
    +5.3 pts
  2. 2
    Manageable size
    If possible, split into smaller modules or carve out a focused entry path. Document where to start in AGENTS.md.
    +1.3 pts
  3. 3
    CI configuration
    Add a CI workflow (e.g. .github/workflows/ci.yml or .gitlab-ci.yml) that runs tests + linter on every PR.
    +0.7 pts

Per-model scores

Claude Code
Weights AGENTS.md and tests heavily — Claude Code leans on an instructions file and a fast feedback loop.
92.8
Cursor
Weights type config and a detailed README highly — Cursor's inline edits benefit from static types and skim-readable docs.
94.1
Devin
Weights CI and reproducible envs highly — Devin runs in a sandboxed VM and needs end-to-end automation.
91.0
GPT-5 Codex
Balanced profile as a reference point.
92.2

Signal breakdown

AGENTS.md / CLAUDE.md· 100% pass
Substantive (12568 chars)
AGENTS.md
CI configuration· 90% pass
CI config present
.gitlab-ci.yml
CONTRIBUTING guide· 100% pass
Guide present
CONTRIBUTING.md
Dependency manifest· 100% pass
Manifest present
go.mod
Reproducible dev env· 100% pass
2 env artifacts (Makefile, makefile)
Makefile
License file· 100% pass
License present
LICENSE
Linter / formatter config· 100% pass
Config detected
.golangci.yml
Pre-commit / git hooks· 0% pass
No pre-commit / husky / lefthook found
README· 100% pass
README detailed (3890 chars)
README.md
Manageable size· 80% pass
1072 files
Test suite· 100% pass
Found /tests
tests
Type configuration· 100% pass
Typed language (Rust/Go)