Microsoft CEO Satya Nadella 呼吁为 AI 模型设置“紧急制动”机制
Microsoft’s Satya Nadella says AI models need an ‘emergency brake’
Microsoft CEO Satya Nadella 近日发文呼吁重构 AI 信任架构，主张将模型与其任务编排系统分离，并实现控制与防护措施的外部化。他建议对所有关键模型操作进行防篡改记录，并建立由授权人员随时暂停或关闭任务中模型的“紧急制动”机制。Nadella 强调应假设模型存在被攻破的风险，并从设计之初就实施有效的隔离与管控。
In Brief
Posted:
2:47 PM PDT · October 10, 2026
Microsoft CEO Satya Nadella is the latest tech executive to offer lengthy thoughts on how AI safety might be improved.
In a Saturday morning post on X, Nadella wrote that it’s time “to step back and assess the trust architecture” of AI.
“We can’t treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,” Nadella wrote, using the Trump administration’s preferred term for AI.
As outlined by Nadella, this approach “means separating the model from the harness that orchestrates its work,” as well as “externalizing controls and safeguards.” He also called for “every meaningful model action” to be documented with “tamper-proof human readable evidence,” and for systems where “an authorized person” always has the ability “to pause or shut down a model mid-task.”
“We must assume a model is compromised and contain it from the start,” he said. “Think of it like an emergency brake.”
Nadella’s comments come as leading AI companies acknowledge more and more incidents where they seemed to lose control of their models, and after Anthropic CEO Dario Amodei published a plan for more cautious AI development.
来源：TechCrunch · AI · techcrunch.com