跳到正文
Rohan Paul· @rohanpaul_ai · X·· 8 天前AI 评分64
AI 导读

Meta 等机构的研究提出 Agent Plasticity 概念,用于衡量智能体从经验中学习并提升未来泛化性能的效率。研究通过冻结模型权重并在国际象棋、围棋、Hex 和 NetHack 等环境中让智能体通过重写工具和笔记进行自我改进,发现表现最好的模型并非学习效率最高的模型,并指出低可塑性智能体常因无法复用相关产物而失败。

正文 · 原文

New Meta paper shows that frontier agents differ widely in how they learn from experience, and the best performer is not the most efficient learner. Most agent tests measure what a model can do once. They ignore whether it gets better by building tools, notes and skills from past attempts, and at what cost. They froze model weights and let agents play chess, Go, Hex and NetHack, rewriting their own tools and notes after each round. They then scored held-out games and defined plasticity as held-out gain per dollar spent learning. In hard chess, Claude Fable 5 rose from 37.5% to 73.3% on held-out games. Across chess, Go and Hex, GPT-5.6 Sol gained 298 points per $1,000 of learning cost, versus 57 for Claude Fable 5. When you evaluate self-improving agents, track held-out learning curves and cost, and check whether the agent actually uses what it saved.

来源:Rohan Paul · x.com