- Dataset
- 2026-10-27-catalog-ai-v2
- Ruleset
- b2e8889c66f7
- Scanned
- 2026-10-27
- Window
- February–September 15, 2026
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
01Result
embeddings-benchmark/mteb ↗embeddings-benchmark/mteb AI coding statistics: 9.1%
Adoption is broad. Many contributors are committing agent-authored work, which is what a real organisational rollout looks like.
02Drivers
What shapes this result
Mode, timing, and detected signatures show whether the result reflects broad adoption or one concentrated workflow.
Assisted or autonomous
Assisted — a developer’s identity authored the commit and the agent added itself as co-author. Autonomous — a bot identity authored the commit without a human identity attached.
Agent share by month
| Month | Agent share | Considered commits |
|---|---|---|
| 2026-02 | 11.7% | 111 |
| 2026-03 | 6.1% | 115 |
| 2026-04 | 9.7% | 175 |
| 2026-05 | 7.4% | 135 |
| 2026-06 | 8.5% | 71 |
| 2026-07 | 5.4% | 111 |
| 2026-08 | 7.6% | 171 |
| 2026-09 | 20.3% | 79 |
Peak month: 20.3%. Bars are scaled to that peak, not to 100%.
Which agents
| Agent | Vendor | Commits | Share |
|---|---|---|---|
| Claude Code | Anthropic | 65 | 6.7% |
| GitHub Copilot | GitHub | 20 | 2.1% |
| Cursor Agent | Anysphere | 5 | 0.5% |
03Evidence
Inspect the matches
Public commit samples let you inspect the signatures behind the aggregate result.
Matched commit samples
f18a0694on GitHubmove Nano retrieval tasks to the v2 dataset format (#5452)Claude Code1dfd69afon GitHubtask: add COCO Modality Equivalence retrieval tasks (#5384)Claude Code6ee088e9on GitHubtask: add BioVITA multimodal retrieval (#5153)Claude Code692bc29con GitHubci: Pin bibtexparser below 2.0.0 (#5423)GitHub Copilot44f4bedbon GitHubfeat: Add sparse encoder (#5087)GitHub Copilota3dfc9d0on GitHubfeat: Add mteb/api FastAPI service for new leaderboard (#4760)GitHub Copilota25a0261on GitHubAdd tencent/EVIE-8B and tencent/EVIE-4.5B (#5450)Cursor Agent9a5dac20on GitHubfix: pin jina omni vllm-free revisions (#4653)Cursor Agent5ff08fa0on GitHubmodel: jina-embeddings-v5-omni models (#4604)Cursor Agent
04Method
What entered the denominator
The result begins with commit history, removes merges and routine automation, and reports literal agent signatures as a lower bound.
Exclusion ledger
| Commits in window | 970 |
| Merge commits removed | −2 |
| CI / dependency bots removed | −0 |
| Considered | 968 |
Bots are excluded from the denominator entirely. Agent attribution requires a literal supported signature; no code-style inference is used.
Continue exploring
Related coding-agent evidence
Run the same detector locally.
Deterministic signature matching; no code-style inference. Squash merges can remove trailers, so this result remains a measured floor.
npx qmmit-cli embeddings-benchmark/mteb