- Dataset
- 2026-10-27-catalog-ai-v2
- Ruleset
- b2e8889c66f7
- Scanned
- 2026-10-27
- Window
- February–September 15, 2026
CommerceAgentBench: Benchmarking Long-Horizon Agents in High-Fidelity, Stateful, and Reproducible Replicas of Real Online Services
01Result
Accio-org/CommerceAgentBench ↗Accio-org/CommerceAgentBench AI coding statistics: 50%
One person is driving this. The headline number reflects a single contributor's workflow, not a project-wide shift.
02Drivers
What shapes this result
Mode, timing, and detected signatures show whether the result reflects broad adoption or one concentrated workflow.
Assisted or autonomous
Assisted — a developer’s identity authored the commit and the agent added itself as co-author. Autonomous — a bot identity authored the commit without a human identity attached.
Which agents
| Agent | Vendor | Commits | Share |
|---|---|---|---|
| Claude Code | Anthropic | 14 | 50% |
03Evidence
Inspect the matches
Public commit samples let you inspect the signatures behind the aggregate result.
Matched commit samples
89b2fe23on GitHubRebrand public name to Commerce Agent Bench and sync leaderboard snapshotClaude Code5acfa6e9on GitHubPoint readers at the Business Arena benchmarkClaude Code88f0f6ccon GitHubRefresh the Qwen reference results and document the thinking requirementClaude Code
04Method
What entered the denominator
The result begins with commit history, removes merges and routine automation, and reports literal agent signatures as a lower bound.
Exclusion ledger
| Commits in window | 33 |
| Merge commits removed | −5 |
| CI / dependency bots removed | −0 |
| Considered | 28 |
Bots are excluded from the denominator entirely. Agent attribution requires a literal supported signature; no code-style inference is used.
Continue exploring
Related coding-agent evidence
Run the same detector locally.
Deterministic signature matching; no code-style inference. Squash merges can remove trailers, so this result remains a measured floor.
npx qmmit-cli Accio-org/CommerceAgentBench