Bidirlm vs Microsoft vs DeepSeek vs OpenAI

Head to head on 21 boards: OpenAI places best on 15, Microsoft places best on 3, DeepSeek places best on 3 and Bidirlm places best on 0. All 4 ranked on 0 of 27 boards.

Two at a time on this screen. Tap one to swap it in.

BBidirlmMicrosoftDeepSeekOpenAI

Board	Read	BBidirlm	Microsoft	DeepSeek	OpenAI
Chat2
MultiChallengeScoretodaytoday	Nov 9todaytoday			#574.9%DeepSeek V4P1 Flash	#182.0%best of the pickedGPT-6.1 Sol
Text ArenaArena ratingtodaytoday	Nov 9todaytoday			#321,475DeepSeek V4.1 Flash	#191,485best of the pickedGPT-5.6 Sol
Reasoning7
MMLU-ProAccuracy · staletodaytoday	Nov 9todaytoday		#7576.0%Phi 4 Plus	#3385.0%DeepSeek-V3.2	#389.3%best of the pickedo1
Epoch ECIECItodaytoday	Nov 9todaytoday			#19159.3DeepSeek V4.1 Flash	#1169.1best of the pickedGPT-6 Astra
ARC-AGI-2Scoretodaytoday	Nov 9todaytoday			#1978.1%DeepSeek V4.1 Flash	#195.0%best of the pickedGPT-6 Astra
GPQA DiamondAccuracytodaytoday	Nov 9todaytoday			#2193.2%DeepSeek V4.1 Flash	#295.8%best of the pickedGPT-6 Astra
AA IntelligenceIndextodaytoday	Nov 9todaytoday			#1632.6DeepSeek V4.1 Flash	#356.9best of the pickedGPT-6 Astra
LiveBenchGlobal averagetodaytoday	Nov 9todaytoday			#881.1%DeepSeek V4.1 Flash	#482.2%best of the pickedGPT-6 Astra
HLEAccuracytodaytoday	Nov 9todaytoday				#154.8%GPT-6 Astra
Coding4
Aider PolyglotPass rate · staletodaytoday	Nov 9todaytoday			#874.2%DeepSeek-V3.2	#188.0%best of the pickedGPT-5
WebDev ArenaArena ratingtodaytoday	Nov 9todaytoday			#141,665DeepSeek V4.1 Flash	#31,770best of the pickedGPT-6 Astra
SWE-bench VerifiedResolved · staletodaytoday	Nov 9todaytoday			#1170.0%DeepSeek-V3.2	#672.8%best of the pickedGPT-5.2
SWE-Bench ProResolvedtodaytoday	Nov 9todaytoday				#490.2%GPT-6 Astra
Agents and tools3
BFCLOverall accuracy · staletodaytoday	Nov 9todaytoday		#5028.8%Phi 4	#1256.7%DeepSeek-V3.2	#763.0%best of the pickedo3
Search ArenaArena ratingtodaytoday	Nov 9todaytoday				#11,255GPT-5.6 Sol
MCP AtlasPass ratetodaytoday	Nov 9todaytoday				#1481.8%GPT-5.6
Vision2
Vision ArenaArena ratingtodaytoday	Nov 9todaytoday			#341,263DeepSeek V4.1 Flash	#81,293best of the pickedGPT-6.1 Sol
Document ArenaArena ratingtodaytoday	Nov 9todaytoday				#51,486GPT-5.6 Sol
Image2
Text-to-ImageArena ratingtodaytoday	Nov 9todaytoday		#61,330MAI Image 2.6		#11,429best of the pickedGPT Image 2.5 Sunburst
Image EditArena ratingtodaytoday	Nov 9todaytoday		#41,467MAI Image 2.7		#11,517best of the pickedGPT Image 2.5 Sunburst
Video1
Text-to-VideoArena ratingtodaytoday	Nov 9todaytoday				#131,367Sora 2 Pro
Speech2
Open ASRAverage WERtodaytoday	Nov 9todaytoday		#35.55 WERbest of the pickedazure-speech-09-2026 (microsoft)		#186.80 WERgpt-transcribe (openai)
Speech ArenaArena ratingtodaytoday	Nov 9todaytoday		#311,145best of the pickedAzure Hd 2.5		#421,107TTS 1 Hd
Embeddings1
MTEBMean task scoretodaytoday	Nov 9todaytoday	#1663.5%BidirLM-Omni-2.5B-Embedding (BidirLM)	#174.3%best of the pickedharrier-oss-v1-27b (microsoft)
Speed1
AA SpeedOutput speedtodaytoday	Nov 9todaytoday			#1323 tok/sbest of the pickedDeepSeek V4 Pro 0813	#1522 tok/sGPT-6.1 Sol
Price1
AA PriceBlended pricetodaytoday	Nov 9todaytoday			#3$0.53best of the pickedDeepSeek V4.1 Flash	#6$2.00GPT-6.1 Terra
Usage1
OpenRouterWeekly tokenstodaytoday	Nov 9todaytoday			#156.0T tokbest of the pickedDeepSeek V4.1 Flash	#47.2T tokGPT-6 Luna

Green marks the best placing among the picked where two or more are ranked; ties are marked for each. Ranks are each board's own order (lower is better), scores as the board published them. Dash: not on that board.