← back to leaderboard

langchain-ai/langchainGitHub

https://github.com/langchain-ai/langchain
Stars:
Default branch:
Last scored:
4h ago
Overall

Strengths

  • AGENTS.md / CLAUDE.md
  • CI configuration
  • License file
  • Pre-commit / git hooks
  • README

Gaps

  • CONTRIBUTING guide
  • Dependency manifest
  • Linter / formatter config
  • Type configuration

Suggestions to improve for a specific model

  1. 1
    Dependency manifest
    Commit a proper manifest (package.json, pyproject.toml, Cargo.toml, go.mod, etc.) plus a lockfile.
    +9.2 pts
  2. 2
    Linter / formatter config
    Configure a linter/formatter (ESLint+Prettier, Biome, Ruff, rustfmt+clippy, golangci-lint) and commit the config.
    +7.9 pts
  3. 3
    Type configuration
    Add a type config (tsconfig.json for JS/TS, mypy.ini or pyrightconfig.json for Python). Rust/Go are typed by default.
    +7.9 pts

Per-model scores

Claude Code
Weights AGENTS.md and tests heavily — Claude Code leans on an instructions file and a fast feedback loop.
58.9
Cursor
Weights type config and a detailed README highly — Cursor's inline edits benefit from static types and skim-readable docs.
51.3
Devin
Weights CI and reproducible envs highly — Devin runs in a sandboxed VM and needs end-to-end automation.
59.1
GPT-5 Codex
Balanced profile as a reference point.
57.5

Signal breakdown

AGENTS.md / CLAUDE.md· 100% pass
Substantive (12946 chars)
AGENTS.md
CI configuration· 100% pass
22 GitHub Actions workflow(s)
.github/workflows
CONTRIBUTING guide· 0% pass
No CONTRIBUTING file
Dependency manifest· 0% pass
No dependency manifest found
Reproducible dev env· 70% pass
Has .devcontainer/devcontainer.json
.devcontainer/devcontainer.json
License file· 100% pass
License present
LICENSE
Linter / formatter config· 0% pass
No linter/formatter config found
Pre-commit / git hooks· 100% pass
Hook framework configured
.pre-commit-config.yaml
README· 100% pass
README detailed (5759 chars)
README.md
Manageable size· 50% pass
2793 files — large
Test suite· 70% pass
Test files detected (.github/scripts/test_release_options.py)
.github/scripts/test_release_options.py
Type configuration· 0% pass
No type config found