Google DeepMind 联合多所大学发布 TheoPhysEval 理论物理评测基准,测试结果显示最强智能体 GPT-6-Astra 在联网状态下成功解出了 50 道未发表研究级物理题中的 49 道。该基准收录的每道题目相当于世界级专家一日的工作量,单题测试成本低于 3 美元。测试还发现智能体在断网时准确率变化很小,表明其对物理文献进行了大量记忆。
New paper from Google Deep Mind, and many top Universities finds the best AI agent tested solved 49 of 50 unpublished research-level theoretical physics problems, each roughly a day's work for a world expert.
at under $3 each.
Benchmarks for AI in physics often use textbook or contest problems, or block the tools real researchers use. So it was unclear how agents handle the calculations that fill daily research.
Experts contributed 50 unpublished problems from their own research, each about a day's work for a specialist. Agents worked alone, with and without web search, and were graded only on final numerical answers.
GPT-6-Astra in Codex solved 49 of 50 with web search, and both it and Opus 5.5 in Claude Code solved 46 of 50 without it. Accuracy barely changed without search, which suggests the models have memorized much of the physics literature.
来源:Rohan Paul · x.com