OpenAI 与 Frontier Model Forum 及其成员机构合作推出了一个新框架,旨在帮助识别绕过 AI 系统安全护栏何时可能导致严重的网络安全威胁,并优先实施更强的保护措施。该框架为评估和比较网络越狱的严重性提供了共同的方法论基础,涵盖其解锁的能力及易用性。共享的方法有助于 AI 与安全社区建立更清晰的证据基础并优先改进安全护栏。
We partnered with @fmf_org and its member firms on a new framework to help identify when bypassing an AI system's safeguards could enable serious cyber harm, and prioritize stronger protections.
"...This framework is an important step toward a common methodology for evaluating and comparing the severity of cyber jailbreaks, including the capabilities they unlock and how readily they can be used. Shared approaches like this can help the AI and security communities build a clearer evidence base and prioritize improvements to safeguards." - OpenAI's Sasha Baker, Head of National Security Policy
来源:OpenAI · x.com