| Chat2 | | | | | |
|---|
MultiChallengeScore1dyesterday | Nov 91dyesterday | | #1067.7%Claude Haiku 5.5 | #182.0%best of the pickedGPT-6.1 Sol | #574.9%DeepSeek V4P1 Flash |
Text ArenaArena rating1dyesterday | Nov 91dyesterday | | #41,505best of the pickedClaude Opus 5.5 | #191,485GPT-5.6 Sol | #321,475DeepSeek V4.1 Flash |
| Reasoning7 | | | | | |
|---|
Epoch ECIECI1dyesterday | Nov 91dyesterday | #76147.1Nemotron 3 Ultra | #3168.4Claude Opus 5.5 | #1169.1best of the pickedGPT-6 Astra | #19159.3DeepSeek V4.1 Flash |
ARC-AGI-2Score1dyesterday | Nov 91dyesterday | #731.9%Nemotron 3.5 Super VL | #393.3%Claude Opus 5.5 | #195.0%best of the pickedGPT-6 Astra | #1978.1%DeepSeek V4.1 Flash |
LiveBenchGlobal average1dyesterday | Nov 91dyesterday | #5867.4%Nemotron 3 Ultra 550B A55B | #183.4%best of the pickedClaude Fable 5.1 | #482.2%GPT-6 Astra | #881.1%DeepSeek V4.1 Flash |
AA IntelligenceIndex1dyesterday | Nov 91dyesterday | #3513.6Nemotron 3.5 Super VL | #259.1best of the pickedClaude Opus 5.5 | #356.9GPT-6 Astra | #1632.6DeepSeek V4.1 Flash |
GPQA DiamondAccuracy1dyesterday | Nov 91dyesterday | #7585.4%Nemotron 3 Ultra | #395.6%Claude Sonnet 5.5 | #295.8%best of the pickedGPT-6 Astra | #2193.2%DeepSeek V4.1 Flash |
MMLU-ProAccuracy · stale1dyesterday | Nov 91dyesterday | #7078.3%Nemotron 3 Nano 30b A3B | #489.1%Claude Opus 4.6 | #389.3%best of the pickedo1 | #3385.0%DeepSeek-V3.2 |
HLEAccuracy1dyesterday | Nov 91dyesterday | | #246.5%Claude Fable 5.1 | #154.8%best of the pickedGPT-6 Astra | |
| Coding4 | | | | | |
|---|
WebDev ArenaArena rating1dyesterday | Nov 91dyesterday | | #11,814best of the pickedClaude Opus 5.5 | #31,770GPT-6 Astra | #141,665DeepSeek V4.1 Flash |
SWE-bench VerifiedResolved · stale1dyesterday | Nov 91dyesterday | | #176.8%best of the pickedClaude Opus 4.5 | #672.8%GPT-5.2 | #1170.0%DeepSeek-V3.2 |
Aider PolyglotPass rate · stale1dyesterday | Nov 91dyesterday | | #1072.0%Claude Opus 4 | #188.0%best of the pickedGPT-5 | #874.2%DeepSeek-V3.2 |
SWE-Bench ProResolved1dyesterday | Nov 91dyesterday | | #198.0%best of the pickedClaude Opus 5 | #490.2%GPT-6 Astra | |
| Agents and tools3 | | | | | |
|---|
BFCLOverall accuracy · stale1dyesterday | Nov 91dyesterday | #8010.0%Llama 3.1 Nemotron Ultra 253b V1 | #177.5%best of the pickedClaude Opus 4.5 | #763.0%o3 | #1256.7%DeepSeek-V3.2 |
MCP AtlasPass rate1dyesterday | Nov 91dyesterday | #2963.1%Nemotron 3 Ultra | #387.2%best of the pickedClaude Fable 5.1 | #1481.8%GPT-5.6 | |
Search ArenaArena rating1dyesterday | Nov 91dyesterday | | #51,229Claude Fable 5 | #11,255best of the pickedGPT-5.6 Sol | |
| Vision2 | | | | | |
|---|
Vision ArenaArena rating1dyesterday | Nov 91dyesterday | #731,211Nvidia Nemotron 3.5 Super VL 120b A12B | #11,309best of the pickedClaude Fable 5 | #81,293GPT-6.1 Sol | #341,263DeepSeek V4.1 Flash |
Document ArenaArena rating1dyesterday | Nov 91dyesterday | | #11,499best of the pickedClaude Fable 5 | #51,486GPT-5.6 Sol | |
| Image2 | | | | | |
|---|
Text-to-ImageArena rating1dyesterday | Nov 91dyesterday | #261,165Cosmos3 Super Text2image | | #11,429best of the pickedGPT Image 2.5 Sunburst | |
Image EditArena rating1dyesterday | Nov 91dyesterday | | | #11,517GPT Image 2.5 Sunburst | |
| Video1 | | | | | |
|---|
Text-to-VideoArena rating1dyesterday | Nov 91dyesterday | | | #131,367Sora 2 Pro | |
| Speech2 | | | | | |
|---|
Open ASRAverage WER1dyesterday | Nov 91dyesterday | #96.13 WERbest of the pickedNVIDIA-Nemotron-3.5-Transcribe-30B-A4B (nvidia) | | #186.80 WERgpt-transcribe (openai) | |
Speech ArenaArena rating1dyesterday | Nov 91dyesterday | #591,064Magpie Multilingual 357m | | #421,107best of the pickedTTS 1 Hd | |
| Embeddings1 | | | | | |
|---|
MTEBMean task score1dyesterday | Nov 91dyesterday | #369.5%llama-embed-nemotron-8b (nvidia) | | | |
| Speed1 | | | | | |
|---|
AA SpeedOutput speed1dyesterday | Nov 91dyesterday | #318 tok/sNemotron 3.5 Super VL | #931 tok/sbest of the pickedClaude Sonnet 5.5 | #1522 tok/sGPT-6.1 Sol | #1323 tok/sDeepSeek V4 Pro 0813 |
| Price1 | | | | | |
|---|
AA PriceBlended price1dyesterday | Nov 91dyesterday | | #1$0.20best of the pickedClaude Haiku 5.5 | #6$2.00GPT-6.1 Terra | #3$0.53DeepSeek V4.1 Flash |
| Usage1 | | | | | |
|---|
OpenRouterWeekly tokens1dyesterday | Nov 91dyesterday | #143.0T tokNemotron 3 Ultra 550B A55B | #66.8T tokClaude Opus 5.5 | #47.2T tokGPT-6 Luna | #156.0T tokbest of the pickedDeepSeek V4.1 Flash |