| Chat2 | | | | | |
|---|
Text ArenaArena ratingtodaytoday | Nov 9todaytoday | | #11,526best of the pickedGemini 4 Carbon | #321,475DeepSeek V4.1 Flash | |
MultiChallengeScoretodaytoday | Nov 9todaytoday | | #278.7%best of the pickedGemini 4 Argon | #574.9%DeepSeek V4P1 Flash | |
| Reasoning7 | | | | | |
|---|
AA IntelligenceIndextodaytoday | Nov 9todaytoday | #3513.6Nemotron 3.5 Super VL | #160.0best of the pickedGemini 4 Carbon | #1632.6DeepSeek V4.1 Flash | |
GPQA DiamondAccuracytodaytoday | Nov 9todaytoday | #7585.4%Nemotron 3 Ultra | #196.4%best of the pickedGemini 4 Argon | #2193.2%DeepSeek V4.1 Flash | |
MMLU-ProAccuracy · staletodaytoday | Nov 9todaytoday | #7078.3%Nemotron 3 Nano 30b A3B | #191.2%best of the pickedGemini 3.1 Pro Preview | #3385.0%DeepSeek-V3.2 | |
ARC-AGI-2Scoretodaytoday | Nov 9todaytoday | #731.9%Nemotron 3.5 Super VL | #591.3%best of the pickedGemini 4 Argon | #1978.1%DeepSeek V4.1 Flash | |
Epoch ECIECItodaytoday | Nov 9todaytoday | #76147.1Nemotron 3 Ultra | #6166.4best of the pickedGemini 4 Argon | #19159.3DeepSeek V4.1 Flash | |
LiveBenchGlobal averagetodaytoday | Nov 9todaytoday | #5867.4%Nemotron 3 Ultra 550B A55B | #1578.8%Gemini 3.7 Flash | #881.1%best of the pickedDeepSeek V4.1 Flash | |
HLEAccuracytodaytoday | Nov 9todaytoday | | #346.4%Gemini 3.1 Pro Preview | | |
| Coding4 | | | | | |
|---|
SWE-bench VerifiedResolved · staletodaytoday | Nov 9todaytoday | | #275.8%best of the pickedGemini 3 Flash | #1170.0%DeepSeek-V3.2 | |
Aider PolyglotPass rate · staletodaytoday | Nov 9todaytoday | | #383.1%best of the pickedGemini 2.5 Pro (Jun 2025) | #874.2%DeepSeek-V3.2 | |
WebDev ArenaArena ratingtodaytoday | Nov 9todaytoday | | #41,767best of the pickedGemini 4 Carbon | #141,665DeepSeek V4.1 Flash | |
SWE-Bench ProResolvedtodaytoday | Nov 9todaytoday | | #392.2%Gemini 4 Argon | | |
| Agents and tools3 | | | | | |
|---|
BFCLOverall accuracy · staletodaytoday | Nov 9todaytoday | #8010.0%Llama 3.1 Nemotron Ultra 253b V1 | #372.5%best of the pickedGemini 3 Pro | #1256.7%DeepSeek-V3.2 | |
MCP AtlasPass ratetodaytoday | Nov 9todaytoday | #2963.1%Nemotron 3 Ultra | #190.7%best of the pickedGemini 4 Argon | | |
Search ArenaArena ratingtodaytoday | Nov 9todaytoday | | #141,208Gemini 3.1 Pro Preview | | |
| Vision2 | | | | | |
|---|
Vision ArenaArena ratingtodaytoday | Nov 9todaytoday | #731,211Nvidia Nemotron 3.5 Super VL 120b A12B | #61,294best of the pickedGemini 3.7 Flash | #341,263DeepSeek V4.1 Flash | |
Document ArenaArena ratingtodaytoday | Nov 9todaytoday | | #161,469Gemini 3.8 Flash | | |
| Image2 | | | | | |
|---|
Text-to-ImageArena ratingtodaytoday | Nov 9todaytoday | #261,165Cosmos3 Super Text2image | #71,325best of the pickedGemini Nano Banana 2.1 | | |
Image EditArena ratingtodaytoday | Nov 9todaytoday | | #81,427Gemini Nano Banana 2.1 | | |
| Video2 | | | | | |
|---|
Text-to-VideoArena ratingtodaytoday | Nov 9todaytoday | | #11,541Gemini Omni 1.2 Flash | | |
Image-to-VideoArena ratingtodaytoday | Nov 9todaytoday | | #11,502Gemini Omni 1.2 Flash | | |
| Speech2 | | | | | |
|---|
Speech ArenaArena ratingtodaytoday | Nov 9todaytoday | #591,064Magpie Multilingual 357m | #61,283Gemini 3.8 Flash TTS | | #11,339best of the pickedEleven V4 |
Open ASRAverage WERtodaytoday | Nov 9todaytoday | #96.13 WERNVIDIA-Nemotron-3.5-Transcribe-30B-A4B (nvidia) | #5813.20 WERgemma-4-E4B-it (google) | | #55.93 WERbest of the pickedscribe v2 (elevenlabs) |
| Embeddings1 | | | | | |
|---|
MTEBMean task scoretodaytoday | Nov 9todaytoday | #369.5%best of the pickedllama-embed-nemotron-8b (nvidia) | #568.4%gemini-embedding-001 (google) | | |
| Speed1 | | | | | |
|---|
AA SpeedOutput speedtodaytoday | Nov 9todaytoday | #318 tok/sNemotron 3.5 Super VL | #735 tok/sbest of the pickedGemini 4 Carbon | #1323 tok/sDeepSeek V4 Pro 0813 | |
| Price1 | | | | | |
|---|
AA PriceBlended pricetodaytoday | Nov 9todaytoday | | #5$1.50Gemini 3.8 Flash | #3$0.53best of the pickedDeepSeek V4.1 Flash | |
| Usage1 | | | | | |
|---|
OpenRouterWeekly tokenstodaytoday | Nov 9todaytoday | #143.0T tokNemotron 3 Ultra 550B A55B | | #156.0T tokbest of the pickedDeepSeek V4.1 Flash | |