SWE-bench Verified
% resolvedShare of real GitHub issues resolved end-to-end.
- #01OpenHands + GPT-571.8%
- #02Moatless Tools + Claude 4 Sonnet70.8%
- #03OpenHands + Claude 4 Sonnet70.4%
- #04SWE-agent + Claude 4 Sonnet66.6%
- #05OpenHands65.8%
- #06OpenHands + Kimi K265.4%
- #07SWE-agent + Claude 3.7 Sonnet w/ Review Heavy62.4%
- #08OpenHands + 4x Scaled (2024-02-03)60.8%
- #09Nemotron-CORTEXA58.2%
- #10OpenHands + CodeAct v2.1 (claude-3-5-sonnet-20241022)53.0%
- #11Composio SWE-Kit (2024-10-25)48.6%
- #12AppMap Navie v247.2%











