跳到正文
Anthropic· @AnthropicAI · X·· 3 小时前AI 评分61
AI 导读

Anthropic 推出 Claude 自评估机制,使模型在每次回复后对对话进行初步安全评估以识别潜在滥用。该技术自 6 月起投入使用,利用模型自身判断力来补充传统分类器未能覆盖的滥用场景。

正文 · 原文

We’ve trained Claude to flag potential misuse in conversations, a technique we call self-assessment. Right after it responds, Claude gives a preliminary safety assessment of the conversation.

Since we began using self-assessment in June, it has surfaced misuse that our other safeguards weren’t designed to catch.

Because Claude has already read the conversation, self-assessment is very efficient. And unlike classifiers, which target a discrete set of harms, it draws on Claude’s own judgment, so it gets more accurate as our models improve.

Read more on our new Safeguards blog:
https://safeguards.anthropic.com/2026/self-assessment/

来源:Anthropic · x.com