多伦多大学与 Google 的论文指出,挑选 AI 助手可能是人类最后一个重大决策,因为之后的决策将由助手代劳。文章认为,当前评估网站对 AI 答案影响的生成式引擎优化(GEO)基准缺乏共享编辑规则,导致不同方法的评分无法横向对比。研究人员建议将每项 GEO 编辑按修改位置、方式及目标提示进行分类,测试时统一允许的编辑并综合报告可见性、答案质量与规则遵循情况。
New University of Toronto and Google paper argues that picking an AI assistant may be the last big decision people make, since that assistant then makes the decisions that follow.
Argues that tests of how websites game AI answers need shared editing rules, or scores can't be compared.
Content owners now edit web pages so AI assistants cite or recommend them, a practice called generative engine optimization, or GEO. Current GEO benchmarks allow different edits, so a method that rewrites whole pages can look better than one that only appends a line.
They propose labeling every GEO edit by where the page changes, how it changes, and which cue it targets, such as authority. Tests would fix the allowed edits and report visibility, answer quality, and rule-following together.
The paper runs no experiments. Its evidence is a mapping of 11 published GEO methods, showing that each covers a different slice of the possible edits.
When comparing GEO methods or AI systems, check which edits each score allowed and whether answer quality was measured.
来源:Rohan Paul · x.com