- Dataset
- 2026-10-27-catalog-ai-v2
- Ruleset
- b2e8889c66f7
- Scanned
- 2026-10-27
- Window
- February–September 15, 2026
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
01Result
open-compass/VLMEvalKit ↗open-compass/VLMEvalKit AI coding statistics: 5.8%
A small group is using agents. Adoption has spread beyond one person but is not project-wide.
02Drivers
What shapes this result
Mode, timing, and detected signatures show whether the result reflects broad adoption or one concentrated workflow.
Assisted or autonomous
Assisted — a developer’s identity authored the commit and the agent added itself as co-author. Autonomous — a bot identity authored the commit without a human identity attached.
Agent share by month
| Month | Agent share | Considered commits |
|---|---|---|
| 2026-02 | 0% | 45 |
| 2026-03 | 13.8% | 29 |
| 2026-04 | 0% | 9 |
| 2026-05 | 8.7% | 23 |
| 2026-06 | 0% | 13 |
| 2026-07 | 33.3% | 9 |
| 2026-08 | 0% | 17 |
| 2026-09 | 0% | 10 |
Peak month: 33.3%. Bars are scaled to that peak, not to 100%.
Which agents
| Agent | Vendor | Commits | Share |
|---|---|---|---|
| Cursor Agent | Anysphere | 4 | 2.6% |
| Claude Code | Anthropic | 3 | 1.9% |
| GitHub Copilot | GitHub | 2 | 1.3% |
03Evidence
Inspect the matches
Public commit samples let you inspect the signatures behind the aggregate result.
Matched commit samples
6a02ab92on GitHub[Benchmark] Add support for LongDocURL (#1595)Cursor Agent3fb3b5bdon GitHub[Benchmark] Add support for MemLens (#1594)Cursor Agent981e805don GitHub[Benchmark] Add support for MMLongBench (#1592)Cursor Agent8f66d2eaon GitHub[Benchmark] Add support for MedQ-DEG-Bench (#1482)Claude Codee7d855a3on GitHub[Minor] macbench: enable interleave by default, move images before text inClaude Code8a904f51on GitHub[Benchmark] Add DA-2K, ERQA, and RefSpatialBench support (#1461)Claude Code589fe36fon GitHub[Benchmark] Add support for MMOral-OPG-Open benchmark (#1484)GitHub Copilot43ce748eon GitHub[Fix] stop poisoning EVAL_FORMAT for subsequent datasets (#1475)GitHub Copilot
04Method
What entered the denominator
The result begins with commit history, removes merges and routine automation, and reports literal agent signatures as a lower bound.
Exclusion ledger
| Commits in window | 155 |
| Merge commits removed | −0 |
| CI / dependency bots removed | −0 |
| Considered | 155 |
Bots are excluded from the denominator entirely. Agent attribution requires a literal supported signature; no code-style inference is used.
Continue exploring
Related coding-agent evidence
Run the same detector locally.
Deterministic signature matching; no code-style inference. Squash merges can remove trailers, so this result remains a measured floor.
npx qmmit-cli open-compass/VLMEvalKit