Anthropic· @AnthropicAI · X·· 3 小时前AI 评分61
AI 导读
Anthropic 推出 Claude 自评估机制,使模型在每次回复后对对话进行初步安全评估以识别潜在滥用。该技术自 6 月起投入使用,利用模型自身判断力来补充传统分类器未能覆盖的滥用场景。
正文 · 原文
We’ve trained Claude to flag potential misuse in conversations, a technique we call self-assessment. Right after it responds, Claude gives a preliminary safety assessment of the conversation.
Since we began using self-assessment in June, it has surfaced misuse that our other safeguards weren’t designed to catch.
Because Claude has already read the conversation, self-assessment is very efficient. And unlike classifiers, which target a discrete set of harms, it draws on Claude’s own judgment, so it gets more accurate as our models improve.
Read more on our new Safeguards blog:
https://safeguards.anthropic.com/2026/self-assessment/
来源:Anthropic · x.com