- Dataset
- 2026-10-27-catalog-ai-v2
- Ruleset
- b2e8889c66f7
- Scanned
- 2026-10-27
- Window
- February–September 15, 2026
Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
01Result
mjpost/sacrebleu ↗mjpost/sacrebleu AI coding statistics: 40%
One person is driving this. The headline number reflects a single contributor's workflow, not a project-wide shift.
02Drivers
What shapes this result
Mode, timing, and detected signatures show whether the result reflects broad adoption or one concentrated workflow.
Assisted or autonomous
Assisted — a developer’s identity authored the commit and the agent added itself as co-author. Autonomous — a bot identity authored the commit without a human identity attached.
Agent share by month
| Month | Agent share | Considered commits |
|---|---|---|
| 2026-07 | 0% | 2 |
| 2026-08 | 66.7% | 3 |
Peak month: 66.7%. Bars are scaled to that peak, not to 100%.
Which agents
| Agent | Vendor | Commits | Share |
|---|---|---|---|
| GitHub Copilot | GitHub | 2 | 40% |
03Evidence
Inspect the matches
Public commit samples let you inspect the signatures behind the aggregate result.
Matched commit samples
b07d346eon GitHubRetry on transient network errors in download_file (fixes CI Error 10054) GitHub Copilote19573b8on GitHubResolve chartboost/ruff-action@v1 violations across the repository (#301)GitHub Copilot
04Method
What entered the denominator
The result begins with commit history, removes merges and routine automation, and reports literal agent signatures as a lower bound.
Exclusion ledger
| Commits in window | 5 |
| Merge commits removed | −0 |
| CI / dependency bots removed | −0 |
| Considered | 5 |
Bots are excluded from the denominator entirely. Agent attribution requires a literal supported signature; no code-style inference is used.
Continue exploring
Related coding-agent evidence
Run the same detector locally.
Deterministic signature matching; no code-style inference. Squash merges can remove trailers, so this result remains a measured floor.
npx qmmit-cli mjpost/sacrebleu