跳到正文
Philipp Schmid· @_philschmid · X·· 7 天前AI 评分64
AI 导读

Google Research 团队发布了 Harness² 框架,允许智能体在冻结模型的基础上自我改进其执行 harness。该框架通过基线记录、编辑代理生成候选修改、组合代理合并有效修改以及反射代理沉淀经验等步骤,使 Gemini 3.5 Flash 在 WorkBuddy-Bench 和 JobBench 等基准上取得显著性能提升。

正文 · 原文

Can Agents improve their own harness on unseen tasks? The @GoogleResearch team released Harness², a framework that allows improve an harness around a frozen model.

How it works:
1️⃣ Agent runs the base harness on each task to record a baseline trajectory
2️⃣ Editor agent inspects the trajectory, drafts 2 candidate edits (SI, Skills, hooks,….), and runs both.
3️⃣ Composer agent diffs the new trajectory against the baseline, merges edits that fixed failures (within a cap), and runs the final harness.
4️⃣ Reflector agent logs verified lessons into file and saves the winning components to a library for future tasks to pull on demand.

Results:
- 💡 Gemini 3.5 Flash +8.4 on WorkBuddy-Bench and +7.5 on JobBench.
- 🛠️ Skills and scripts drive ~50% of edits; dropping skills costs 5.3 pts.
- 📚 Gemini 3.5 Flash improves on all 3 benchmarks when editing its own harness.

Paper: https://arxiv.org/abs/2610.14224
Code: https://github.com/google-research/harness2

来源:Philipp Schmid · x.com