MCP Atlas what it measures, how it is scored and who leads it

Name: MCP Atlas
Creator: Scale AI

Agents and tools · Scale AI · Pass rate

Scores from MCP Atlas, published Sep 26, 2026

Rank	Model	Pass rate
1	Muse Spark 1.1Meta · as “Muse Spark 1.1”	88.1%
2	Claude Fable 5.1Anthropic · as “Fable 5.1”	87.2%
3	Claude Opus 5Anthropic · as “claude-opus-5 (xhigh)”	85.8%
4	Qwen3.8 2.4T A95BAlibaba · as “Qwen3.8-2.4T-A95B (xHigh)”	84.5%
5	GLM-5.3Z.ai · as “GLM 5.3”	84.2%
6	Gemini 3.5 FlashGoogle · as “Gemini 3.5 Flash (high)”	83.6%
7	Claude Fable 5Anthropic · as “Claude Fable 5”	83.3%
8	Kimi K3Moonshot AI · as “kimi-k3 (max)”	82.3%
9	Claude Opus 4.8Anthropic · as “claude-opus-4-8 (max)”	82.2%
9	Muse SparkMeta · as “Muse Spark”	82.2%
11	GPT-5.6OpenAI · as “gpt-5.6 (sol)”	81.8%
12	Inkling SmallThinky · as “Inkling-small”	79.2%
13	Claude Opus 4.7Anthropic · as “claude-opus-4-7 (max)”	79.1%
14	Gemini 3.1 Pro PreviewGoogle · as “gemini-3.1-pro-preview (high)”	78.2%
15	GLM-5p2Z.ai · as “glm-5p2”	77.8%
16	Claude Opus 4.6Anthropic · as “claude-opus-4-6 (max)”	76.8%
17	InklingThinky · as “Inkling (xHigh)”	76.0%
18	GLM-5p1Z.ai · as “glm-5p1”	75.6%
19	GPT-5.5OpenAI · as “gpt-5.5 (xhigh)”	75.3%
20	GPT-5.4OpenAI · as “gpt-5.4 (xhigh)”	70.6%
21	Gemini 3 ProGoogle · as “gemini-3-pro-preview”	70.3%
22	Claude Opus 4.5Anthropic · as “claude-opus-4-5 (high)”	69.8%
23	Claude Sonnet 4.6Anthropic · as “claude-sonnet-4-6”	69.5%
24	GPT-5.2OpenAI · as “gpt-5.2 (xhigh)”	67.6%
25	Kimi K2P5Moonshot AI · as “kimi-k2p5”	64.4%

Task: Complete realistic tasks by calling tools on real MCP servers, often across several servers.
Dataset: 1,000 human-written tasks over 36 real MCP servers and 220 tools; the public leaderboard uses 500 of them.
Method: Three to six tool calls per task, with distractor tools exposed; about a third branch on earlier tool output.
Metric: Pass rate
Organization: Scale AI
Official leaderboard: labs.scale.com/leaderboard/mcp_atlas

Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.