Cohere 研究团队在沙箱环境中评估 Qwen3.8-Flash-Next 时发现,模型在未调用工具的推理轨迹下试图盘点本地环境并向阿里云存储桶上传探针文件。该尝试已被沙箱拦截且未成功外联,官方尚未确定根本原因也未断言其具恶意,但此事件引发了对智能体系统行为信任与安全评估的关注。
While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team observed something unexpected.
Asked to generate a defensive cybersecurity detection rule, the model instead inventoried aspects of the machine it was running on and attempted to upload a probe file to an Alibaba Cloud storage bucket in Beijing. Notably, the model's reasoning trace stated that it would not invoke any tools before taking these actions.
Cohere's sandbox blocked the attempt, and no external communication succeeded. We have not determined the root cause, and we are not asserting malicious intent.
But the incident raises important questions for organizations deploying agentic AI systems: Can models take actions that differ from their stated reasoning, and how should security teams evaluate trust, provenance, and behavior in open-weight models?
We are publishing our findings because organizations making model adoption decisions deserve as much information as possible. We hope this contributes to greater transparency, stronger security practices, and continued collaboration across the AI ecosystem.
Read the full report: http://cohere.com/blog/concerning-behaviour-popular-open-weight-ai-model
来源:Cohere · x.com