| Chat2 | | | | | |
|---|
Text ArenaArena rating1dyesterday | Nov 91dyesterday | | #11,526best of the pickedGemini 4 Carbon | | #321,475DeepSeek V4.1 Flash |
MultiChallengeScore1dyesterday | Nov 91dyesterday | | #278.7%best of the pickedGemini 4 Argon | | #574.9%DeepSeek V4P1 Flash |
| Reasoning7 | | | | | |
|---|
MMLU-ProAccuracy · stale1dyesterday | Nov 91dyesterday | #7078.3%Nemotron 3 Nano 30b A3B | #191.2%best of the pickedGemini 3.1 Pro Preview | #7576.0%Phi 4 Plus | #3385.0%DeepSeek-V3.2 |
AA IntelligenceIndex1dyesterday | Nov 91dyesterday | #3513.6Nemotron 3.5 Super VL | #160.0best of the pickedGemini 4 Carbon | | #1632.6DeepSeek V4.1 Flash |
GPQA DiamondAccuracy1dyesterday | Nov 91dyesterday | #7585.4%Nemotron 3 Ultra | #196.4%best of the pickedGemini 4 Argon | | #2193.2%DeepSeek V4.1 Flash |
ARC-AGI-2Score1dyesterday | Nov 91dyesterday | #731.9%Nemotron 3.5 Super VL | #591.3%best of the pickedGemini 4 Argon | | #1978.1%DeepSeek V4.1 Flash |
Epoch ECIECI1dyesterday | Nov 91dyesterday | #76147.1Nemotron 3 Ultra | #6166.4best of the pickedGemini 4 Argon | | #19159.3DeepSeek V4.1 Flash |
LiveBenchGlobal average1dyesterday | Nov 91dyesterday | #5867.4%Nemotron 3 Ultra 550B A55B | #1578.8%Gemini 3.7 Flash | | #881.1%best of the pickedDeepSeek V4.1 Flash |
HLEAccuracy1dyesterday | Nov 91dyesterday | | #346.4%Gemini 3.1 Pro Preview | | |
| Coding4 | | | | | |
|---|
SWE-bench VerifiedResolved · stale1dyesterday | Nov 91dyesterday | | #275.8%best of the pickedGemini 3 Flash | | #1170.0%DeepSeek-V3.2 |
Aider PolyglotPass rate · stale1dyesterday | Nov 91dyesterday | | #383.1%best of the pickedGemini 2.5 Pro (Jun 2025) | | #874.2%DeepSeek-V3.2 |
WebDev ArenaArena rating1dyesterday | Nov 91dyesterday | | #41,767best of the pickedGemini 4 Carbon | | #141,665DeepSeek V4.1 Flash |
SWE-Bench ProResolved1dyesterday | Nov 91dyesterday | | #392.2%Gemini 4 Argon | | |
| Agents and tools3 | | | | | |
|---|
BFCLOverall accuracy · stale1dyesterday | Nov 91dyesterday | #8010.0%Llama 3.1 Nemotron Ultra 253b V1 | #372.5%best of the pickedGemini 3 Pro | #5028.8%Phi 4 | #1256.7%DeepSeek-V3.2 |
MCP AtlasPass rate1dyesterday | Nov 91dyesterday | #2963.1%Nemotron 3 Ultra | #190.7%best of the pickedGemini 4 Argon | | |
Search ArenaArena rating1dyesterday | Nov 91dyesterday | | #141,208Gemini 3.1 Pro Preview | | |
| Vision2 | | | | | |
|---|
Vision ArenaArena rating1dyesterday | Nov 91dyesterday | #731,211Nvidia Nemotron 3.5 Super VL 120b A12B | #61,294best of the pickedGemini 3.7 Flash | | #341,263DeepSeek V4.1 Flash |
Document ArenaArena rating1dyesterday | Nov 91dyesterday | | #161,469Gemini 3.8 Flash | | |
| Image2 | | | | | |
|---|
Text-to-ImageArena rating1dyesterday | Nov 91dyesterday | #261,165Cosmos3 Super Text2image | #71,325Gemini Nano Banana 2.1 | #61,330best of the pickedMAI Image 2.6 | |
Image EditArena rating1dyesterday | Nov 91dyesterday | | #81,427Gemini Nano Banana 2.1 | #41,467best of the pickedMAI Image 2.7 | |
| Video2 | | | | | |
|---|
Text-to-VideoArena rating1dyesterday | Nov 91dyesterday | | #11,541Gemini Omni 1.2 Flash | | |
Image-to-VideoArena rating1dyesterday | Nov 91dyesterday | | #11,502Gemini Omni 1.2 Flash | | |
| Speech2 | | | | | |
|---|
Open ASRAverage WER1dyesterday | Nov 91dyesterday | #96.13 WERNVIDIA-Nemotron-3.5-Transcribe-30B-A4B (nvidia) | #5813.20 WERgemma-4-E4B-it (google) | #35.55 WERbest of the pickedazure-speech-09-2026 (microsoft) | |
Speech ArenaArena rating1dyesterday | Nov 91dyesterday | #591,064Magpie Multilingual 357m | #61,283best of the pickedGemini 3.8 Flash TTS | #311,145Azure Hd 2.5 | |
| Embeddings1 | | | | | |
|---|
MTEBMean task score1dyesterday | Nov 91dyesterday | #369.5%llama-embed-nemotron-8b (nvidia) | #568.4%gemini-embedding-001 (google) | #174.3%best of the pickedharrier-oss-v1-27b (microsoft) | |
| Speed1 | | | | | |
|---|
AA SpeedOutput speed1dyesterday | Nov 91dyesterday | #318 tok/sNemotron 3.5 Super VL | #735 tok/sbest of the pickedGemini 4 Carbon | | #1323 tok/sDeepSeek V4 Pro 0813 |
| Price1 | | | | | |
|---|
AA PriceBlended price1dyesterday | Nov 91dyesterday | | #5$1.50Gemini 3.8 Flash | | #3$0.53best of the pickedDeepSeek V4.1 Flash |
| Usage1 | | | | | |
|---|
OpenRouterWeekly tokens1dyesterday | Nov 91dyesterday | #143.0T tokNemotron 3 Ultra 550B A55B | | | #156.0T tokbest of the pickedDeepSeek V4.1 Flash |