P P99lab Anthropic OpenAI Microsoft Head to head on 25 boards: Anthropic places best on 13 , OpenAI places best on 11 , P99lab places best on 1 and Microsoft places best on 1 (a tie counts for each). All 4 ranked on 0 of 27 boards.
Board Read P P99lab Anthropic OpenAI Microsoft Chat2 MultiChallenge Score 1d yesterday Oct 26 1d yesterday #8 67.7% Claude Haiku 5.5 #1 82.0% best of the picked GPT-6.1 Sol Text Arena Arena rating 1d yesterday Oct 26 1d yesterday #2 1,509 best of the picked Claude Opus 5.5 #18 1,485 GPT-5.6 Sol Reasoning7 MMLU-Pro Accuracy · stale 1d yesterday Oct 26 1d yesterday #4 89.1% Claude Opus 4.6 #3 89.3% best of the picked o1 #75 76.0% Phi 4 Plus AA Intelligence Index 1d yesterday Oct 26 1d yesterday #1 57.6 best of the picked Claude Opus 5.5 #6 52.7 GPT-6 Astra HLE Accuracy 1d yesterday Oct 26 1d yesterday #2 46.5% Claude Fable 5.1 #1 54.8% best of the picked GPT-6 Astra Epoch ECI ECI 1d yesterday Oct 26 1d yesterday #1 168.8 best of the picked Claude Opus 5.5 #2 168.8 GPT-6 Astra ARC-AGI-2 Score 1d yesterday Oct 26 1d yesterday #3 93.3% Claude Opus 5.5 #1 95.0% best of the picked GPT-6 Astra LiveBench Global average 1d yesterday Oct 26 1d yesterday #1 83.4% best of the picked Claude Fable 5.1 #4 82.2% GPT-6 Astra GPQA Diamond Accuracy 1d yesterday Oct 26 1d yesterday #3 95.6% Claude Sonnet 5.5 #2 95.8% best of the picked GPT-6 Astra Coding4 WebDev Arena Arena rating 1d yesterday Oct 26 1d yesterday #1 1,807 best of the picked Claude Opus 5.5 #2 1,774 GPT-6 Astra SWE-Bench Pro Resolved 1d yesterday Oct 26 1d yesterday #1 98.0% best of the picked Claude Opus 5 #4 90.2% GPT-6 Astra SWE-bench Verified Resolved · stale 1d yesterday Oct 26 1d yesterday #1 76.8% best of the picked Claude Opus 4.5 #6 72.8% GPT-5.2 Aider Polyglot Pass rate · stale 1d yesterday Oct 26 1d yesterday #10 72.0% Claude Opus 4 #1 88.0% best of the picked GPT-5 Agents and tools3 BFCL Overall accuracy · stale 1d yesterday Oct 26 1d yesterday #1 77.5% best of the picked Claude Opus 4.5 #7 63.0% o3 #50 28.8% Phi 4 Search Arena Arena rating 1d yesterday Oct 26 1d yesterday #4 1,233 Claude Fable 5.1 #1 1,258 best of the picked GPT-5.6 Sol MCP Atlas Pass rate 1d yesterday Oct 26 1d yesterday #2 87.2% best of the picked Claude Fable 5.1 #11 81.8% GPT-5.6 Vision2 Vision Arena Arena rating 1d yesterday Oct 26 1d yesterday #1 1,309 best of the picked Claude Fable 5 #7 1,294 GPT-6.1 Sol Document Arena Arena rating 1d yesterday Oct 26 1d yesterday #1 1,499 best of the picked Claude Fable 5 #6 1,489 GPT-5.6 Sol Image2 Text-to-Image Arena rating 1d yesterday Oct 26 1d yesterday #1 1,425 best of the picked GPT Image 2.5 Sunburst #5 1,332 MAI Image 2.6 Image Edit Arena rating 1d yesterday Oct 26 1d yesterday #1 1,514 best of the picked GPT Image 2.5 Sunburst #6 1,425 MAI Image 2.6 Video1 Text-to-Video Arena rating 1d yesterday Oct 26 1d yesterday #11 1,368 Sora 2 Pro Speech2 Open ASR Average WER 1d yesterday Oct 26 1d yesterday #3 4.98 WER best of the picked audrey-0.7 (p99lab) #21 5.96 WER gpt-transcribe (openai) #4 5.02 WER azure-speech-07-2026 (microsoft) Speech Arena Arena rating 1d yesterday Oct 26 1d yesterday #39 1,105 TTS 1 Hd #29 1,143 best of the picked Azure Hd 2.5 Embeddings1 MTEB Mean task score 1d yesterday Oct 26 1d yesterday #1 74.3% harrier-oss-v1-27b (microsoft) Speed1 AA Speed Output speed 1d yesterday Oct 26 1d yesterday #3 234 tok/s best of the picked Claude Haiku 5.5 #12 129 tok/s GPT-6 Luna Price1 AA Price Blended price 1d yesterday Oct 26 1d yesterday #3 $0.20 best of the picked Claude Haiku 5.5 #3 $0.20 best of the picked GPT-6 Luna Usage1 OpenRouter Weekly tokens 1d yesterday Oct 26 1d yesterday #6 8.3T tok Claude Opus 5.5 #5 8.4T tok best of the picked GPT-6 Luna
Green marks the best placing among the picked where two or more are ranked; ties are marked for each. Ranks are each board's own order (lower is better), scores as the board published them. Dash: not on that board.