| Chat2 | | | | |
|---|
Text ArenaArena rating1dyesterday | Nov 91dyesterday | #321,475DeepSeek V4.1 Flash | #41,505Claude Opus 5.5 | #11,526best of the pickedGemini 4 Carbon |
MultiChallengeScore1dyesterday | Nov 91dyesterday | #574.9%DeepSeek V4P1 Flash | #1067.7%Claude Haiku 5.5 | #278.7%best of the pickedGemini 4 Argon |
| Reasoning7 | | | | |
|---|
AA IntelligenceIndex1dyesterday | Nov 91dyesterday | #1632.6DeepSeek V4.1 Flash | #259.1Claude Opus 5.5 | #160.0best of the pickedGemini 4 Carbon |
GPQA DiamondAccuracy1dyesterday | Nov 91dyesterday | #2193.2%DeepSeek V4.1 Flash | #395.6%Claude Sonnet 5.5 | #196.4%best of the pickedGemini 4 Argon |
LiveBenchGlobal average1dyesterday | Nov 91dyesterday | #881.1%DeepSeek V4.1 Flash | #183.4%best of the pickedClaude Fable 5.1 | #1578.8%Gemini 3.7 Flash |
MMLU-ProAccuracy · stale1dyesterday | Nov 91dyesterday | #3385.0%DeepSeek-V3.2 | #489.1%Claude Opus 4.6 | #191.2%best of the pickedGemini 3.1 Pro Preview |
Epoch ECIECI1dyesterday | Nov 91dyesterday | #19159.3DeepSeek V4.1 Flash | #3168.4best of the pickedClaude Opus 5.5 | #6166.4Gemini 4 Argon |
ARC-AGI-2Score1dyesterday | Nov 91dyesterday | #1978.1%DeepSeek V4.1 Flash | #393.3%best of the pickedClaude Opus 5.5 | #591.3%Gemini 4 Argon |
HLEAccuracy1dyesterday | Nov 91dyesterday | | #246.5%best of the pickedClaude Fable 5.1 | #346.4%Gemini 3.1 Pro Preview |
| Coding4 | | | | |
|---|
WebDev ArenaArena rating1dyesterday | Nov 91dyesterday | #141,665DeepSeek V4.1 Flash | #11,814best of the pickedClaude Opus 5.5 | #41,767Gemini 4 Carbon |
SWE-bench VerifiedResolved · stale1dyesterday | Nov 91dyesterday | #1170.0%DeepSeek-V3.2 | #176.8%best of the pickedClaude Opus 4.5 | #275.8%Gemini 3 Flash |
Aider PolyglotPass rate · stale1dyesterday | Nov 91dyesterday | #874.2%DeepSeek-V3.2 | #1072.0%Claude Opus 4 | #383.1%best of the pickedGemini 2.5 Pro (Jun 2025) |
SWE-Bench ProResolved1dyesterday | Nov 91dyesterday | | #198.0%best of the pickedClaude Opus 5 | #392.2%Gemini 4 Argon |
| Agents and tools3 | | | | |
|---|
BFCLOverall accuracy · stale1dyesterday | Nov 91dyesterday | #1256.7%DeepSeek-V3.2 | #177.5%best of the pickedClaude Opus 4.5 | #372.5%Gemini 3 Pro |
MCP AtlasPass rate1dyesterday | Nov 91dyesterday | | #387.2%Claude Fable 5.1 | #190.7%best of the pickedGemini 4 Argon |
Search ArenaArena rating1dyesterday | Nov 91dyesterday | | #51,229best of the pickedClaude Fable 5 | #141,208Gemini 3.1 Pro Preview |
| Vision2 | | | | |
|---|
Vision ArenaArena rating1dyesterday | Nov 91dyesterday | #341,263DeepSeek V4.1 Flash | #11,309best of the pickedClaude Fable 5 | #61,294Gemini 3.7 Flash |
Document ArenaArena rating1dyesterday | Nov 91dyesterday | | #11,499best of the pickedClaude Fable 5 | #161,469Gemini 3.8 Flash |
| Image2 | | | | |
|---|
Text-to-ImageArena rating1dyesterday | Nov 91dyesterday | | | #71,325Gemini Nano Banana 2.1 |
Image EditArena rating1dyesterday | Nov 91dyesterday | | | #81,427Gemini Nano Banana 2.1 |
| Video2 | | | | |
|---|
Text-to-VideoArena rating1dyesterday | Nov 91dyesterday | | | #11,541Gemini Omni 1.2 Flash |
Image-to-VideoArena rating1dyesterday | Nov 91dyesterday | | | #11,502Gemini Omni 1.2 Flash |
| Speech2 | | | | |
|---|
Speech ArenaArena rating1dyesterday | Nov 91dyesterday | | | #61,283Gemini 3.8 Flash TTS |
Open ASRAverage WER1dyesterday | Nov 91dyesterday | | | #5813.20 WERgemma-4-E4B-it (google) |
| Embeddings1 | | | | |
|---|
MTEBMean task score1dyesterday | Nov 91dyesterday | | | #568.4%gemini-embedding-001 (google) |
| Speed1 | | | | |
|---|
AA SpeedOutput speed1dyesterday | Nov 91dyesterday | #1323 tok/sDeepSeek V4 Pro 0813 | #931 tok/sClaude Sonnet 5.5 | #735 tok/sbest of the pickedGemini 4 Carbon |
| Price1 | | | | |
|---|
AA PriceBlended price1dyesterday | Nov 91dyesterday | #3$0.53DeepSeek V4.1 Flash | #1$0.20best of the pickedClaude Haiku 5.5 | #5$1.50Gemini 3.8 Flash |
| Usage1 | | | | |
|---|
OpenRouterWeekly tokens1dyesterday | Nov 91dyesterday | #156.0T tokbest of the pickedDeepSeek V4.1 Flash | #66.8T tokClaude Opus 5.5 | |