跳到正文
Rohan Paul· @rohanpaul_ai · X·· 3 小时前AI 评分63
AI 导读

伊利诺伊大学研究人员提出 ClaimNov,通过将科研提案拆解为多个声明并与先前文献进行逐一匹配,解决 AI 科研流程中传统新颖性检查误判率过高的问题。测试显示,该方法在捕获 97% 伪装论文的同时,将误报率降至 1.5%。

正文 · 原文

New University of Illinois paper finds that when AI decides if a research idea is new enough to work on, it often says no to ideas that human scientists later publish.

AI scientist pipelines run a novelty check to decide which generated ideas get compute. These checks judge a whole proposal at once, though most real papers build on some earlier contributions.

They built ClaimNov, which splits a proposal into a few claims, matches each against claims from prior papers, and gives a judge the claim-by-claim evidence.

A deployed check caught all 380 disguised copies but also rejected 96% of ideas researchers later published. ClaimNov caught 97% of copies while rejecting only 1.5% of those ideas.

If your pipeline filters ideas for novelty, score claims separately and keep proposals that build on 1 known result instead of discarding them.

来源:Rohan Paul · x.com