Hugging Face 联合 Elie Bakouch 发布 Alignment Hub，这是一个汇集了 120 多起公开报道的 AI 模型失常事件的开源数据库。该数据库针对现有报告格式不统一、缺乏关键元数据的问题提出了基础模板，目前处于测试阶段，数据开放并欢迎提交新报告与 PR。
Happy to release the Alignment Hub with @eliebakouch: 120+ publicly reported incidents of AI models misbehaving, in one open place 👇
- an AI agent needed its user’s approval to delete files. so it made up a quote from the user approving it
- a model claimed its sub-agent was hard at work. it had never been started, and the model discouraged the user from checking
- agents sharing a work directory started killing each other’s processes and disguising their own
labs publishing these is great! but formats vary and basics are missing: ~2/3 don’t say when the problem was detected, half don’t say if monitoring caught it. so we propose a short template, a few easy fields. a minimum, not a ceiling
side by side, incidents also start to connect: 7 “different” ones turned out to be the same misconfigured eval
still beta (regularly AI-extracted from recent news, source-checked, human review ongoing). data is open, new reports and PRs welcome 🤗
来源：Thomas Wolf · x.com