Open weights vs Closed weights

Head to head on 28 boards: Closed weights places best on 25 and Open weights places best on 3. Both ranked on 28 of 28 boards.

Board	Read	Open weights	Closed weights
Chat2
Text ArenaArena rating1dyesterday	Nov 111dyesterday	#161,487Kimi K3	#11,526best of the pickedGemini 4 Carbon
MultiChallengeScore1dyesterday	Nov 111dyesterday	#674.2%Muse Spark Open	#182.0%best of the pickedGPT-6.1 Sol
Reasoning7
AA IntelligenceIndex1dyesterday	Nov 111dyesterday	#1732.6DeepSeek V4.1 Flash	#164.6best of the pickedClaude Fable 5.2
HLEAccuracy1dyesterday	Nov 111dyesterday	#1724.4%Kimi K2.5	#154.8%best of the pickedGPT-6 Astra
GPQA DiamondAccuracy1dyesterday	Nov 111dyesterday	#2393.2%DeepSeek V4.1 Flash	#196.5%best of the pickedGemini 4 Carbon
Epoch ECIECI1dyesterday	Nov 111dyesterday	#21159.3DeepSeek V4.1 Flash	#1174.2best of the pickedClaude Fable 5.2
ARC-AGI-2Score1dyesterday	Nov 111dyesterday	#2178.1%DeepSeek V4.1 Flash	#195.0%best of the pickedGPT-6 Astra
LiveBenchGlobal average1dyesterday	Nov 111dyesterday	#881.1%DeepSeek V4.1 Flash	#183.4%best of the pickedClaude Fable 5.1
MMLU-ProAccuracy · stale1dyesterday	Nov 111dyesterday	#688.0%MiniMax M2.1	#191.2%best of the pickedGemini 3.1 Pro Preview
Coding4
WebDev ArenaArena rating1dyesterday	Nov 111dyesterday	#151,664DeepSeek V4.1 Flash	#11,836best of the pickedClaude Fable 5.2
SWE-Bench ProResolved1dyesterday	Nov 111dyesterday	#688.2%Kimi K3	#198.0%best of the pickedClaude Opus 5
SWE-bench VerifiedResolved · stale1dyesterday	Nov 111dyesterday	#275.8%MiniMax-M2.5	#176.8%best of the pickedClaude Opus 4.5
Aider PolyglotPass rate · stale1dyesterday	Nov 111dyesterday	#874.2%DeepSeek-V3.2	#188.0%best of the pickedGPT-5
Agents and tools3
BFCLOverall accuracy · stale1dyesterday	Nov 111dyesterday	#472.4%GLM 4.6	#177.5%best of the pickedClaude Opus 4.5
MCP AtlasPass rate1dyesterday	Nov 111dyesterday	#784.5%Qwen3.8 2.4T A95B	#190.7%best of the pickedGemini 4 Argon
Search ArenaArena rating1dyesterday	Nov 111dyesterday	#401,062Diffbot Small Xl	#11,255best of the pickedGPT-5.6 Sol
Vision2
Vision ArenaArena rating1dyesterday	Nov 111dyesterday	#291,272GLM 5.3 Flash	#11,309best of the pickedClaude Fable 5
Document ArenaArena rating1dyesterday	Nov 111dyesterday	#261,452Gemma 4 31B	#11,500best of the pickedClaude Fable 5
Image2
Text-to-ImageArena rating1dyesterday	Nov 111dyesterday	#191,227Qwen Image 2.1	#11,429best of the pickedGPT Image 2.5 Sunburst
Image EditArena rating1dyesterday	Nov 111dyesterday	#201,363Qwen Image 2.1	#11,520best of the pickedGPT Image 2.5 Sunburst
Video2
Text-to-VideoArena rating1dyesterday	Nov 111dyesterday	#111,456MiniMax H3	#11,540best of the pickedGemini Omni 1.2 Flash
Image-to-VideoArena rating1dyesterday	Nov 111dyesterday	#31,493MiniMax H3	#11,503best of the pickedGemini Omni 1.2 Flash
Speech2
Speech ArenaArena rating1dyesterday	Nov 111dyesterday	#71,274Fish Audio Drama 3	#11,338best of the pickedEleven V4
Open ASRAverage WER1dyesterday	Nov 111dyesterday	#116.15 WERQwen3-ASR-1.7B-hf (Qwen)	#25.21 WERbest of the pickedspeech-v3.1 (OtterAI)
Embeddings1
MTEBMean task score1dyesterday	Nov 111dyesterday	#174.3%best of the pickedharrier-oss-v1-27b (microsoft)	#568.4%gemini-embedding-001 (google)
Speed1
AA SpeedOutput speed1dyesterday	Nov 111dyesterday	#163 tok/sbest of the pickedMiMo-V2.6-Flash	#256 tok/sQwen3.8 Max (0902)
Price1
AA PriceBlended price1dyesterday	Nov 111dyesterday	#4$0.53DeepSeek V4.1 Flash	#1$0.20best of the pickedClaude Haiku 5.5
Usage1
OpenRouterWeekly tokens1dyesterday	Nov 111dyesterday	#153.8T tokbest of the pickedDeepSeek V4.1 Flash	#47.0T tokGPT-6 Luna

Green marks the best placing among the picked where two or more are ranked; ties are marked for each. Ranks are each board's own order (lower is better), scores as the board published them. Dash: not on that board.