Meta 发布新论文介绍了一种名为 Retrospective Self-Distillation 的多轮自进化框架,让 AI 智能体通过事后回顾自身包含失败在内的无标签运行轨迹来学习并提升表现。在 ScienceWorld 上,Qwen3-14B 的成功率从 12.9% 提升至 20.6%;在 ALFWorld 上,Qwen3-8B 达到了 76.6% 的成功率。
New Meta paper finds that AI agents can learn from their own past attempts at tasks, even ones nobody marked right or wrong, by looking back at each step once they know how it ended.
Most agent runs come with no correct answer and no reward, which standard training relies on. RSD has the same model reread each finished run, knowing how it ended and what worked on similar tasks. It scores every action, and the agent learns from those scores.
On ScienceWorld, Qwen3-14B's success rate rose from 12.9% to 20.6%. On ALFWorld, Qwen3-8B hit 76.6%, beating every other method tested, even ones given rewards or ground truth.
Keep your agent's unlabeled runs, failures included, and train it on a hindsight review of them. Rebuild the review each round, since frozen notes left ALFWorld success at 59.7% by round 3, versus 67.9% with fresh ones.
来源:Rohan Paul · x.com