- Dataset
- 2026-10-27-catalog-ai-v2
- Ruleset
- b2e8889c66f7
- Scanned
- 2026-10-27
- Window
- February–September 15, 2026
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
01Result
modelscope/evalscope ↗modelscope/evalscope AI coding statistics: 4.8%
Adoption is broad. Many contributors are committing agent-authored work, which is what a real organisational rollout looks like.
02Drivers
What shapes this result
Mode, timing, and detected signatures show whether the result reflects broad adoption or one concentrated workflow.
Assisted or autonomous
Assisted — a developer’s identity authored the commit and the agent added itself as co-author. Autonomous — a bot identity authored the commit without a human identity attached.
Agent share by month
| Month | Agent share | Considered commits |
|---|---|---|
| 2026-02 | 0% | 4 |
| 2026-03 | 2.9% | 34 |
| 2026-04 | 18.2% | 33 |
| 2026-05 | 7.8% | 51 |
| 2026-06 | 5.6% | 36 |
| 2026-07 | 6% | 67 |
| 2026-08 | 0.9% | 114 |
| 2026-09 | 0% | 38 |
Peak month: 18.2%. Bars are scaled to that peak, not to 100%.
Which agents
| Agent | Vendor | Commits | Share |
|---|---|---|---|
| Gemini CLI | 9 | 2.4% | |
| Claude Code | Anthropic | 7 | 1.9% |
| GitHub Copilot | GitHub | 4 | 1.1% |
03Evidence
Inspect the matches
Public commit samples let you inspect the signatures behind the aggregate result.
Matched commit samples
ee252436on GitHubfix(perf): honor dict body fields in line_by_line dataset (#1485)Gemini CLI85debb7fon GitHubfix: Handle multi-line SSE format with id, event, and data fields (#1474)Gemini CLI0f57de7con GitHub[update] volcengine sandbox (#1337)Gemini CLIbca26a42on GitHubdocs: fix stale ModelAPI docstrings (#1634)Claude Code82395a74on GitHubfix(perf): generate HTML report for open-loop runs with no fixed rate (ratClaude Codeff7feff6on GitHubfix: support code execution scoring on Windows (#1488)Claude Code85debb7fon GitHubfix: Handle multi-line SSE format with id, event, and data fields (#1474)GitHub Copilot8cded2aeon GitHubadd Maritime-OCR-Bench support (#1388)GitHub Copilot4b03567aon GitHubsupport line_by_line_oai custom dataset mode (#1342)GitHub Copilot
04Method
What entered the denominator
The result begins with commit history, removes merges and routine automation, and reports literal agent signatures as a lower bound.
Exclusion ledger
| Commits in window | 380 |
| Merge commits removed | −3 |
| CI / dependency bots removed | −0 |
| Considered | 377 |
Bots are excluded from the denominator entirely. Agent attribution requires a literal supported signature; no code-style inference is used.
Continue exploring
Related coding-agent evidence
Run the same detector locally.
Deterministic signature matching; no code-style inference. Squash merges can remove trailers, so this result remains a measured floor.
npx qmmit-cli modelscope/evalscope