- Dataset
- 2026-10-27-catalog-ai-v2
- Ruleset
- b2e8889c66f7
- Scanned
- 2026-10-27
- Window
- February–September 15, 2026
PinchBench is a benchmarking system for evaluating LLM models as OpenClaw coding agents. Made with 🦀 by the humans at https://kilo.ai
01Result
pinchbench/skill ↗pinchbench/skill AI coding statistics: 5.1%
A small group is using agents. Adoption has spread beyond one person but is not project-wide.
02Drivers
What shapes this result
Mode, timing, and detected signatures show whether the result reflects broad adoption or one concentrated workflow.
Assisted or autonomous
Assisted — a developer’s identity authored the commit and the agent added itself as co-author. Autonomous — a bot identity authored the commit without a human identity attached.
Agent share by month
| Month | Agent share | Considered commits |
|---|---|---|
| 2026-02 | 0% | 49 |
| 2026-03 | 7.4% | 54 |
| 2026-04 | 6.6% | 121 |
| 2026-05 | 0% | 13 |
Peak month: 7.4%. Bars are scaled to that peak, not to 100%.
Which agents
| Agent | Vendor | Commits | Share |
|---|---|---|---|
| Claude Code | Anthropic | 11 | 4.6% |
| GitHub Copilot | GitHub | 1 | 0.4% |
03Evidence
Inspect the matches
Public commit samples let you inspect the signatures behind the aggregate result.
Matched commit samples
8750d29bon GitHubfix(transcript): filter stale sessions by mtime in sessions.json resolverClaude Code979ee148on GitHubfix(grader): support 'arguments' key for tool calls in task_10_workflowClaude Code63f6dd3aon GitHubfix(grader): strip list prefixes before extracting numbers in task_openclaClaude Coded8bd12faon GitHubUpdate scripts/lib_grading.pyGitHub Copilot
04Method
What entered the denominator
The result begins with commit history, removes merges and routine automation, and reports literal agent signatures as a lower bound.
Exclusion ledger
| Commits in window | 383 |
| Merge commits removed | −142 |
| CI / dependency bots removed | −4 |
| Considered | 237 |
Bots are excluded from the denominator entirely. Agent attribution requires a literal supported signature; no code-style inference is used.
Continue exploring
Related coding-agent evidence
Run the same detector locally.
Deterministic signature matching; no code-style inference. Squash merges can remove trailers, so this result remains a measured floor.
npx qmmit-cli pinchbench/skill