Agent Friendly Code
← back to leaderboard

openai/openai-cookbookGitHub

https://github.com/openai/openai-cookbook
Stars:
—
Default branch:
—
Last scored:
4h ago
Overall

Strengths

  • AGENTS.md / CLAUDE.md
  • CI configuration
  • CONTRIBUTING guide
  • License file
  • README

Gaps

  • Dependency manifest
  • Reproducible dev env
  • Linter / formatter config
  • Pre-commit / git hooks
  • Test suite

Suggestions to improve for a specific model

  1. 1
    Test suite
    Add a tests/ (or test/, __tests__/, spec/) directory with runnable tests. Document how to run them in AGENTS.md.
    +13.2 pts
  2. 2
    Reproducible dev env
    Add a Makefile or devcontainer or Dockerfile so the agent can set up the project in one command.
    +11.8 pts
  3. 3
    Dependency manifest
    Commit a proper manifest (package.json, pyproject.toml, Cargo.toml, go.mod, etc.) plus a lockfile.
    +9.2 pts

Per-model scores

Claude Code
Weights AGENTS.md and tests heavily — Claude Code leans on an instructions file and a fast feedback loop.
41.4
Cursor
Weights type config and a detailed README highly — Cursor's inline edits benefit from static types and skim-readable docs.
39.4
Devin
Weights CI and reproducible envs highly — Devin runs in a sandboxed VM and needs end-to-end automation.
42.5
GPT-5 Codex
Balanced profile as a reference point.
43.2

Signal breakdown

AGENTS.md / CLAUDE.md· 100% pass
Substantive (5558 chars)
AGENTS.md
CI configuration· 100% pass
3 GitHub Actions workflow(s)
.github/workflows
CONTRIBUTING guide· 100% pass
Guide present
CONTRIBUTING.md
Dependency manifest· 0% pass
No dependency manifest found
Reproducible dev env· 0% pass
No Makefile / devcontainer / Docker / equivalent found
License file· 100% pass
License present
LICENSE
Linter / formatter config· 0% pass
No linter/formatter config found
Pre-commit / git hooks· 0% pass
No pre-commit / husky / lefthook found
README· 100% pass
README detailed (1208 chars)
README.md
Manageable size· 50% pass
2878 files — large
Test suite· 0% pass
No test directory or test files found
Type configuration· 0% pass
No type config found