Bidirlm vs Microsoft vs DeepSeek vs Google

Head to head on 20 boards: Google places best on 14, Microsoft places best on 4, DeepSeek places best on 2 and Bidirlm places best on 0. All 4 ranked on 0 of 28 boards.

Two at a time on this screen. Tap one to swap it in.

BBidirlmMicrosoftDeepSeekGoogle

Board	Read	BBidirlm	Microsoft	DeepSeek	Google
Chat2
Text ArenaArena ratingtodaytoday	Nov 9todaytoday			#321,475DeepSeek V4.1 Flash	#11,526best of the pickedGemini 4 Carbon
MultiChallengeScoretodaytoday	Nov 9todaytoday			#574.9%DeepSeek V4P1 Flash	#278.7%best of the pickedGemini 4 Argon
Reasoning7
MMLU-ProAccuracy · staletodaytoday	Nov 9todaytoday		#7576.0%Phi 4 Plus	#3385.0%DeepSeek-V3.2	#191.2%best of the pickedGemini 3.1 Pro Preview
AA IntelligenceIndextodaytoday	Nov 9todaytoday			#1632.6DeepSeek V4.1 Flash	#160.0best of the pickedGemini 4 Carbon
GPQA DiamondAccuracytodaytoday	Nov 9todaytoday			#2193.2%DeepSeek V4.1 Flash	#196.4%best of the pickedGemini 4 Argon
ARC-AGI-2Scoretodaytoday	Nov 9todaytoday			#1978.1%DeepSeek V4.1 Flash	#591.3%best of the pickedGemini 4 Argon
Epoch ECIECItodaytoday	Nov 9todaytoday			#19159.3DeepSeek V4.1 Flash	#6166.4best of the pickedGemini 4 Argon
LiveBenchGlobal averagetodaytoday	Nov 9todaytoday			#881.1%best of the pickedDeepSeek V4.1 Flash	#1578.8%Gemini 3.7 Flash
HLEAccuracytodaytoday	Nov 9todaytoday				#346.4%Gemini 3.1 Pro Preview
Coding4
SWE-bench VerifiedResolved · staletodaytoday	Nov 9todaytoday			#1170.0%DeepSeek-V3.2	#275.8%best of the pickedGemini 3 Flash
Aider PolyglotPass rate · staletodaytoday	Nov 9todaytoday			#874.2%DeepSeek-V3.2	#383.1%best of the pickedGemini 2.5 Pro (Jun 2025)
WebDev ArenaArena ratingtodaytoday	Nov 9todaytoday			#141,665DeepSeek V4.1 Flash	#41,767best of the pickedGemini 4 Carbon
SWE-Bench ProResolvedtodaytoday	Nov 9todaytoday				#392.2%Gemini 4 Argon
Agents and tools3
BFCLOverall accuracy · staletodaytoday	Nov 9todaytoday		#5028.8%Phi 4	#1256.7%DeepSeek-V3.2	#372.5%best of the pickedGemini 3 Pro
MCP AtlasPass ratetodaytoday	Nov 9todaytoday				#190.7%Gemini 4 Argon
Search ArenaArena ratingtodaytoday	Nov 9todaytoday				#141,208Gemini 3.1 Pro Preview
Vision2
Vision ArenaArena ratingtodaytoday	Nov 9todaytoday			#341,263DeepSeek V4.1 Flash	#61,294best of the pickedGemini 3.7 Flash
Document ArenaArena ratingtodaytoday	Nov 9todaytoday				#161,469Gemini 3.8 Flash
Image2
Image EditArena ratingtodaytoday	Nov 9todaytoday		#41,467best of the pickedMAI Image 2.7		#81,427Gemini Nano Banana 2.1
Text-to-ImageArena ratingtodaytoday	Nov 9todaytoday		#61,330best of the pickedMAI Image 2.6		#71,325Gemini Nano Banana 2.1
Video2
Text-to-VideoArena ratingtodaytoday	Nov 9todaytoday				#11,541Gemini Omni 1.2 Flash
Image-to-VideoArena ratingtodaytoday	Nov 9todaytoday				#11,502Gemini Omni 1.2 Flash
Speech2
Open ASRAverage WERtodaytoday	Nov 9todaytoday		#35.55 WERbest of the pickedazure-speech-09-2026 (microsoft)		#5813.20 WERgemma-4-E4B-it (google)
Speech ArenaArena ratingtodaytoday	Nov 9todaytoday		#311,145Azure Hd 2.5		#61,283best of the pickedGemini 3.8 Flash TTS
Embeddings1
MTEBMean task scoretodaytoday	Nov 9todaytoday	#1663.5%BidirLM-Omni-2.5B-Embedding (BidirLM)	#174.3%best of the pickedharrier-oss-v1-27b (microsoft)		#568.4%gemini-embedding-001 (google)
Speed1
AA SpeedOutput speedtodaytoday	Nov 9todaytoday			#1323 tok/sDeepSeek V4 Pro 0813	#735 tok/sbest of the pickedGemini 4 Carbon
Price1
AA PriceBlended pricetodaytoday	Nov 9todaytoday			#3$0.53best of the pickedDeepSeek V4.1 Flash	#5$1.50Gemini 3.8 Flash
Usage1
OpenRouterWeekly tokenstodaytoday	Nov 9todaytoday			#156.0T tokDeepSeek V4.1 Flash

Green marks the best placing among the picked where two or more are ranked; ties are marked for each. Ranks are each board's own order (lower is better), scores as the board published them. Dash: not on that board.