- Dataset
- 2026-10-27-catalog-ai-v2
- Ruleset
- b2e8889c66f7
- Scanned
- 2026-10-27
- Window
- February–September 15, 2026
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
01Result
EvolvingLMMs-Lab/lmms-eval ↗EvolvingLMMs-Lab/lmms-eval AI coding statistics: 4.3%
Adoption is broad. Many contributors are committing agent-authored work, which is what a real organisational rollout looks like.
02Drivers
What shapes this result
Mode, timing, and detected signatures show whether the result reflects broad adoption or one concentrated workflow.
Assisted or autonomous
Assisted — a developer’s identity authored the commit and the agent added itself as co-author. Autonomous — a bot identity authored the commit without a human identity attached.
Agent share by month
| Month | Agent share | Considered commits |
|---|---|---|
| 2026-02 | 0% | 52 |
| 2026-03 | 1.7% | 58 |
| 2026-04 | 11.1% | 18 |
| 2026-05 | 6.7% | 30 |
| 2026-06 | 16.7% | 12 |
| 2026-07 | 10.8% | 37 |
| 2026-08 | 0% | 36 |
| 2026-09 | 0% | 15 |
Peak month: 16.7%. Bars are scaled to that peak, not to 100%.
Which agents
| Agent | Vendor | Commits | Share |
|---|---|---|---|
| Claude Code | Anthropic | 8 | 3.1% |
| GitHub Copilot | GitHub | 2 | 0.8% |
| Cursor Agent | Anysphere | 1 | 0.4% |
03Evidence
Inspect the matches
Public commit samples let you inspect the signatures behind the aggregate result.
Matched commit samples
2515c897on GitHubfeat: add Kaleidoscope multilingual exam benchmark (#1412)Claude Code5937b934on GitHubAdd Qwen-native JSON coordinate variants for pointing tasks (#1409)Claude Code220ad5d0on GitHubfix(grounding/rec): guard empty metric bucket against ZeroDivisionError (#Claude Code247bebd8on GitHubfix: update llava_onevision2 checkpoint repo path (#1345)GitHub Copilot78d6c72bon GitHubfeat: add ReVSI evaluation (#1307)GitHub Copilotd8fcb9c3on GitHub[Feature] v0.7: Operational simplicity and pipeline maturity for users (huCursor Agent
04Method
What entered the denominator
The result begins with commit history, removes merges and routine automation, and reports literal agent signatures as a lower bound.
Exclusion ledger
| Commits in window | 261 |
| Merge commits removed | −2 |
| CI / dependency bots removed | −1 |
| Considered | 258 |
Bots are excluded from the denominator entirely. Agent attribution requires a literal supported signature; no code-style inference is used.
Continue exploring
Related coding-agent evidence
Run the same detector locally.
Deterministic signature matching; no code-style inference. Squash merges can remove trailers, so this result remains a measured floor.
npx qmmit-cli EvolvingLMMs-Lab/lmms-eval