跳到正文
Rohan Paul· @rohanpaul_ai · X·· 6 天前AI 评分61
AI 导读

普林斯顿大学等机构的新研究表明,将多位开发者构建的专用智能体组合在一起,其 GAIA 准确率可达 70%,超越单一开发者的通用智能体。研究通过模拟固定预算下的多开发者智能体群体,发现各自准确率不超过 35% 的专员组合后性能显著提升,超出中位通用智能体 12 个百分点。

正文 · 原文

New Princeton paper finds that combining specialized agents from many developers can beat any single developer's general agent, with GAIA accuracy reaching 70%.

Today most agentic systems are built and controlled by 1 developer, so each team rebuilds the same basic skills. The authors argue this limits scale.

They simulated populations of developers with LLM agents that build agents under a fixed budget, then compared lone systems with a multi-developer system. The multi-developer system splits each task and routes the parts to different developers' agents.

On GAIA with the same total development budget, specialists that each scored at most 35% alone reached 70% together. That is 12 points above the median general agent, while on web-search-only SealQA the combined system did worse at higher cost.

Build agents to fill gaps in shared systems, since an agent scoring 19% alone lifted a combined system from 40% to 53%.

来源:Rohan Paul · x.com