AI Agents & Models benchmarks
How performance is measured at the frontier · as of 2026-09-11 · 7 benchmarks
Capability
LMArena Text Arena
Arena ScoreStyle-controlled, crowd-voted head-to-head preference rating.
↑ higher is better·LMArena
- #011,507
- #021,505
- #031,504
- #041,502
- #051,499
- #061,498
- #071,494
- #081,494
- #091,493
- #101,492
- #111,491
- #121,489
LiveBench
% scoreObjective, contamination-resistant evaluation across reasoning, coding, mathematics, data analysis, language, and instruction following.
↑ higher is better·LiveBench
- #01
claude-fable-5-1-max-effort 83.4% - #02
claude-fable-5-max-effort 83.0% - #0382.2%
- #0481.6%
- #0581.1%
- #0681.1%
- #0780.2%
- #0880.1%
- #0979.5%
- #1079.2%
- #1178.8%
- #1278.5%
SWE-bench Verified
% resolvedShare of real GitHub issues the model resolves end-to-end.
↑ higher is better·SWE-bench
- #0171.8%
- #02
Moatless Tools + Claude 4 Sonnet 70.8% - #03
OpenHands + Claude 4 Sonnet 70.4% - #04
SWE-agent + Claude 4 Sonnet 66.6% - #0565.8%
- #0665.4%
- #07
SWE-agent + Claude 3.7 Sonnet w/ Review Heavy 62.4% - #08
OpenHands + 4x Scaled (2024-02-03) 60.8% - #0958.2%
- #10
OpenHands + CodeAct v2.1 (claude-3-5-sonnet-20241022) 53.0% - #11
Composio SWE-Kit (2024-10-25) 48.6% - #1247.2%
Agents
LMArena Agent Arena
IPS scoreReal-session agent quality across task outcomes, steerability, recovery, and tool use.
↑ higher is better·LMArena Agent Arena
- #010.145
- #020.125
- #030.114
- #040.108
- #050.092
- #060.077
- #070.077
- #080.066
- #090.063
- #100.054
- #110.053
- #120.046
Reasoning
ARC-AGI-2
% accuracyVerified accuracy on novel abstract-reasoning tasks from ARC Prize's semi-private set.
↑ higher is better·ARC Prize
- #0195.00%
- #0293.33%
- #0392.50%
- #0492.08%
- #0592.08%
- #0690.42%
- #0790.00%
- #0890.00%
- #0990.00%
- #1089.17%
- #1188.75%
- #1288.33%
Economics
Blended cost
$ / 1M tokensPublished price, 3:1 input:output blend — lower is cheaper.
↓ lower is better·LiteLLM (open pricing)
- #01$0.45
- #02$1.71
- #03$1.98
- #04$2.15
- #05$3.00
- #06$3.38
- #07$4.50
- #08$4.50
- #09$6.00
- #10$8.00
- #11$10.00
Context
- #011M
- #021M
- #031M
- #041M
- #051M
- #061M
- #07922K
- #08922K
- #09922K
- #10500K
- #11262.1K
