GPQA (Diamond) what it measures, how it is scored and who leads it

Name: GPQA (Diamond)
Creator: New York University
Published: 2023-11-20

Knowledge · New York University · introduced Nov 20, 2023 · Accuracy

Scores from GPQA Diamond (Epoch AI runs), published Sep 2, 2026

Rank	Model	Accuracy
1	GPT-6 AstraOpenAI · as “gpt-6-astra_max”	95.8%
2	Gemini 3.8 FlashGoogle · as “gemini-3.8-flash_high”	95.4%
3	Gemini 3.7 FlashGoogle · as “gemini-3.7-flash_high”	94.8%
4	GPT-5.4 ProOpenAI · as “gpt-5.4-pro-2026-03-05_xhigh”	94.6%
5	Gemini 3.1 Pro PreviewGoogle · as “gemini-3.1-pro-preview_high”	94.4%
6	Gemini 3.6 FlashGoogle · as “gemini-3.6-flash_high”	94.1%
7	GPT-5.5 Pre ReleaseOpenAI · as “gpt-5.5-pre-release_xhigh”	94.0%
7	Grok 4.6SpaceXAI · as “grok-4.6_high”	94.0%
9	GPT-5.5 Pro Pre ReleaseOpenAI · as “gpt-5.5-pro-pre-release_xhigh”	93.9%
10	Claude Opus 5Anthropic · as “claude-opus-5_max”	93.9%
11	GPT-5.6 SolOpenAI · as “gpt-5.6-sol_max”	93.5%
12	Grok 4.5SpaceXAI · as “grok-4.5_high”	93.4%
13	GPT-5.6 TerraOpenAI · as “gpt-5.6-terra_max”	93.3%
14	GPT-5.4OpenAI · as “gpt-5.4-2026-03-05_xhigh”	93.3%
15	Kimi K3Moonshot AI · as “kimi-k3_max”	93.1%
16	Gemini 3.5 FlashGoogle · as “gemini-3.5-flash_high”	92.8%
17	Qwen3.8 Max (0902)Alibaba · as “qwen3.8-max_xhigh”	92.7%
18	Gemini 3 ProGoogle · as “gemini-3-pro-preview”	92.6%
19	GLM-5.2Z.ai · as “glm-5.2_max”	91.9%
20	DeepSeek V4 Pro 0813DeepSeek · as “deepseek-v4-pro-0813_max”	91.7%
21	GPT-5.6 LunaOpenAI · as “gpt-5.6-luna_max”	91.6%
22	GPT-5.2OpenAI · as “gpt-5.2-2025-12-11_xhigh”	91.4%
23	Claude Opus 4.8Anthropic · as “claude-opus-4-8_max”	91.0%
23	DeepSeek V4 Flash VisionDeepSeek · as “deepseek-v4-flash-0731_max”	91.0%
25	GLM-5.3Z.ai · as “glm-5.3_max”	90.9%

Task: Answer graduate-level biology, physics and chemistry questions that non-experts cannot look up.
Dataset: 448 multiple-choice questions written by domain experts; the Diamond subset keeps the 198 hardest and cleanest.
Method: Four-option multiple choice. Experts with PhDs reached 65%, skilled non-experts with web access 34%.
Metric: Accuracy
Organization: New York University
Introduced: Nov 20, 2023
Paper: GPQA: A Graduate-Level Google-Proof Q&A Benchmark (arXiv 2311.12022)
Official leaderboard: epoch.ai/benchmarks/gpqa-diamond
Home: github.com/idavidrein/gpqa

Newest first. New versions are added, never rewritten.

Version	Date	What changed
1Main set of 448 questions and the 198-question Diamond subset.	Nov 20, 20232 years ago	Main set of 448 questions and the 198-question Diamond subset.

Sources: each benchmark's paper (arXiv) and its official site or leaderboard. Scores are the boards captured here every day, exactly as published.