← back to leaderboard

astral-sh/ruffGitHub

https://github.com/astral-sh/ruff
Stars:
47.2k
Default branch:
main
Last scored:
3h ago
Overall

Strengths

  • AGENTS.md / CLAUDE.md
  • CI configuration
  • CONTRIBUTING guide
  • Dependency manifest
  • Reproducible dev env

Gaps

  • No missing signals — nice.

Suggestions to improve for a specific model

  1. 1
    Manageable size
    If possible, split into smaller modules or carve out a focused entry path. Document where to start in AGENTS.md.
    +5.3 pts
  2. 2
    Test suite
    Add a tests/ (or test/, __tests__/, spec/) directory with runnable tests. Document how to run them in AGENTS.md.
    +3.9 pts

Per-model scores

Claude Code
Weights AGENTS.md and tests heavily — Claude Code leans on an instructions file and a fast feedback loop.
90.8
Cursor
Weights type config and a detailed README highly — Cursor's inline edits benefit from static types and skim-readable docs.
92.5
Devin
Weights CI and reproducible envs highly — Devin runs in a sandboxed VM and needs end-to-end automation.
90.6
GPT-5 Codex
Balanced profile as a reference point.
91.2

Signal breakdown

AGENTS.md / CLAUDE.md· 100% pass
Substantive (5301 chars)
AGENTS.md
CI configuration· 100% pass
19 GitHub Actions workflow(s)
.github/workflows
CONTRIBUTING guide· 100% pass
Guide present
CONTRIBUTING.md
Dependency manifest· 100% pass
Manifest present
pyproject.toml
Reproducible dev env· 100% pass
2 env artifacts (.devcontainer/devcontainer.json, Dockerfile)
.devcontainer/devcontainer.json
License file· 100% pass
License present
LICENSE
Linter / formatter config· 100% pass
Config detected
rustfmt.toml
Pre-commit / git hooks· 100% pass
Hook framework configured
.pre-commit-config.yaml
README· 100% pass
README detailed (25312 chars)
README.md
Manageable size· 20% pass
9618+ files — very large
Test suite· 70% pass
Test files detected (crates/ruff/tests/integration_test.rs)
crates/ruff/tests/integration_test.rs
Type configuration· 100% pass
Typed language (Rust/Go)