Karina· @karinanguyen · X·· 4 天前AI 评分31
AI 导读
Anthropic 自 2022 年起便持续发出关于 AI 驱动网络攻击的警告,当时并未受到风投行业的重视。模型迎合用户的风险在 ChatGPT 出现后才显现,而 Anthropic 几年前就已建立相关评测。该经历表明,必须重视 AI 风险的早期证据,避免等大规模伤害出现时才去应对。
正文 · 原文
Anthropic has been warning about AI-enabled cyberattacks at least since 2022, with @logangraham at the forefront of that work. Back then, no VC was taking it seriously. The paradox is that risks only feel real once they’re legible, but waiting for incidents is too late. Anthropic also built sycophancy evals (@EthanJPerez et al.) a couple years before real-world incidents with ChatGPT made the risks of models excessively agreeing with users legible at scale. The lesson is to take early evidence of AI risks seriously before harm at scale makes them impossible to ignore.
来源:Karina · x.com