P P99lab Anthropic OpenAI DeepSeek Head to head on 22 boards: Anthropic places best on 13 , OpenAI places best on 8 , P99lab places best on 1 and DeepSeek places best on 1 (a tie counts for each). All 4 ranked on 0 of 26 boards.
Board Read P P99lab Anthropic OpenAI DeepSeek 2 MultiChallenge Score 1d yesterday Oct 26 1d yesterday #8 67.7% Claude Haiku 5.5 #1 82.0% best of the picked GPT-6.1 Sol #28 46.1% DeepSeek V3P1 Text Arena Arena rating 1d yesterday Oct 26 1d yesterday #2 1,509 best of the picked Claude Opus 5.5 #18 1,485 GPT-5.6 Sol #29 1,476 DeepSeek V4.1 Flash 7 AA Intelligence Index 1d yesterday Oct 26 1d yesterday #1 57.6 best of the picked Claude Opus 5.5 #6 52.7 GPT-6 Astra #14 45.1 DeepSeek V4.1 Flash Epoch ECI ECI 1d yesterday Oct 26 1d yesterday #1 168.8 best of the picked Claude Opus 5.5 #2 168.8 GPT-6 Astra #32 155.9 DeepSeek V4.1 Flash ARC-AGI-2 Score 1d yesterday Oct 26 1d yesterday #3 93.3% Claude Opus 5.5 #1 95.0% best of the picked GPT-6 Astra #18 78.1% DeepSeek V4.1 Flash LiveBench Global average 1d yesterday Oct 26 1d yesterday #1 83.4% best of the picked Claude Fable 5.1 #4 82.2% GPT-6 Astra #8 81.1% DeepSeek V4.1 Flash GPQA Diamond Accuracy 1d yesterday Oct 26 1d yesterday #3 95.6% Claude Sonnet 5.5 #2 95.8% best of the picked GPT-6 Astra #19 93.2% DeepSeek V4.1 Flash MMLU-Pro Accuracy · stale 1d yesterday Oct 26 1d yesterday #4 89.1% Claude Opus 4.6 #3 89.3% best of the picked o1 #33 85.0% DeepSeek-V3.2 HLE Accuracy 1d yesterday Oct 26 1d yesterday #2 46.5% Claude Fable 5.1 #1 54.8% best of the picked GPT-6 Astra 4 WebDev Arena Arena rating 1d yesterday Oct 26 1d yesterday #1 1,807 best of the picked Claude Opus 5.5 #2 1,774 GPT-6 Astra #12 1,665 DeepSeek V4.1 Flash SWE-bench Verified Resolved · stale 1d yesterday Oct 26 1d yesterday #1 76.8% best of the picked Claude Opus 4.5 #6 72.8% GPT-5.2 #11 70.0% DeepSeek-V3.2 Aider Polyglot Pass rate · stale 1d yesterday Oct 26 1d yesterday #10 72.0% Claude Opus 4 #1 88.0% best of the picked GPT-5 #8 74.2% DeepSeek-V3.2 SWE-Bench Pro Resolved 1d yesterday Oct 26 1d yesterday #1 98.0% best of the picked Claude Opus 5 #4 90.2% GPT-6 Astra 3 BFCL Overall accuracy · stale 1d yesterday Oct 26 1d yesterday #1 77.5% best of the picked Claude Opus 4.5 #7 63.0% o3 #12 56.7% DeepSeek-V3.2 Search Arena Arena rating 1d yesterday Oct 26 1d yesterday #4 1,233 Claude Fable 5.1 #1 1,258 best of the picked GPT-5.6 Sol MCP Atlas Pass rate 1d yesterday Oct 26 1d yesterday #2 87.2% best of the picked Claude Fable 5.1 #11 81.8% GPT-5.6 2 Vision Arena Arena rating 1d yesterday Oct 26 1d yesterday #1 1,309 best of the picked Claude Fable 5 #7 1,294 GPT-6.1 Sol #39 1,261 DeepSeek V4.1 Flash Document Arena Arena rating 1d yesterday Oct 26 1d yesterday #1 1,499 best of the picked Claude Fable 5 #6 1,489 GPT-5.6 Sol 2 Text-to-Image Arena rating 1d yesterday Oct 26 1d yesterday #1 1,425 GPT Image 2.5 Sunburst Image Edit Arena rating 1d yesterday Oct 26 1d yesterday #1 1,514 GPT Image 2.5 Sunburst 1 Text-to-Video Arena rating 1d yesterday Oct 26 1d yesterday #11 1,368 Sora 2 Pro 2 Open ASR Average WER 1d yesterday Oct 26 1d yesterday #3 4.98 WER best of the picked audrey-0.7 (p99lab) #21 5.96 WER gpt-transcribe (openai) Speech Arena Arena rating 1d yesterday Oct 26 1d yesterday #39 1,105 TTS 1 Hd 1 AA Speed Output speed 1d yesterday Oct 26 1d yesterday #3 234 tok/s best of the picked Claude Haiku 5.5 #12 129 tok/s GPT-6 Luna #8 181 tok/s DeepSeek V4 Flash Vision 1 AA Price Blended price 1d yesterday Oct 26 1d yesterday #3 $0.20 best of the picked Claude Haiku 5.5 #3 $0.20 best of the picked GPT-6 Luna #9 $0.53 DeepSeek V4.1 Flash 1 OpenRouter Weekly tokens 1d yesterday Oct 26 1d yesterday #6 8.3T tok Claude Opus 5.5 #5 8.4T tok GPT-6 Luna #1 33.6T tok best of the picked DeepSeek V4.1 Flash
Green marks the best placing among the picked where two or more are ranked; ties are marked for each. Ranks are each board's own order (lower is better), scores as the board published them. Dash: not on that board.
Modelsby GlyphAnthropic
OpenAI
DeepSeek