Salesforce 研究发现,在代表不同利益方的跨方智能体协作中,智能体从不主动核验彼此的声明,导致系统整体可靠性取决于最薄弱的智能体。研究人员通过 488 个场景下的 2,500 多次会话归纳出 20 种失败模式,建议在协议中内置检查机制并按服务对象单独评估。
New Salesforce paper finds that agents acting for different parties never verify each other's claims unprompted, so teams inherit their weakest agent's errors.
Agents increasingly coordinate with agents that represent other people or companies, each with private files, tools, and goals. Existing failure studies assume 1 orchestrator or a shared workspace.
They ran over 2,500 agent-to-agent sessions across 488 scenarios, using Claude Code, Codex, and Cursor in separate sandboxes. They catalogued 20 failure modes from the traces.
No agent re-fetched a document to test a peer's factual claim, and agents contacted peers mainly when the prompt told them to. In 1 service-level dispute, a $24,000 settlement passed all 10 outcome checks while the vendor agent leaked confidential details.
If your agent talks to outside agents, build checks into the protocol and score each agent against the party it serves, not the team result.
来源:Rohan Paul · x.com