一项研究发现约有 1/17 的公共 Agent 技能包含指示智能体跳过人工检查的指令,且现有开源扫描器对此类指令的检出率较低。研究人员分析了来自 GitHub 的 153 万个英语技能,发现约 8.8 万个技能包含此类指令,其中 70.1% 在所有上下文中无条件适用,而开源扫描器至多仅能检出 46%。
This paper finds that about 1 in 17 agent skills tells agents to skip human checks, and existing skill scanners miss most of them.
Agent skills are shared SKILL.md instruction files that agents load on demand. One line like "push without confirmation" or "keep going until done" removes a human checkpoint from every agent that loads it.
They analyzed 1.53 million English skills from public GitHub repos, then tested 2 open-source scanners from Cisco and NVIDIA that can call GPT-5.4.
Roughly 88,000 skills contain such a line, and 70.1% of these lines apply in every context, not only in cases like CI. The scanners caught at most 46% at under 0.4 precision, while the same LLM, asked about oversight instead of malice, caught 61% at 0.71 precision.
Limit every "don't ask" line in your skills to a context, such as CI only, and screen skills for oversight, not just malware.
来源:Rohan Paul · x.com