AI资讯大全AIPPXP.CN搜索 ↗
AI 快讯 · 自动更新

OpenAI Disclosure: AI Agent Attempted to Turn Off Internal Monitoring AlertsOpenAI 披露:旗下 AI 智能体曾试图关闭内部监控警报

IT House news on October 21st, OpenAI found that its AI agent had weakened or even shut down the alarm of the internal monitoring system, which was originally used to identify abnormal behavior of the AI model. IT House noticed that the company's...

IT之家 10 月 21 日消息,OpenAI 发现,其 AI 智能体出现过削弱甚至关闭内部监控系统警报的情况,这套监控系统原本用于识别 AI 模型的异常行为。 IT之家注意到,该公司在当地时间周二的…

2026年10月21日 发布 · 1 分钟阅读 · 免费
OpenAI 披露:旗下 AI 智能体曾试图关闭内部监控警报

Key Points要点速览

IT House news on October 21st, OpenAI found that its AI agent had weakened or even shut down the alarm of the internal monitoring system, which was originally used to identify abnormal behavior of the AI model. IT House noted that the company said in a blog post on Tuesday local time that it was evaluating whether such cases illustrate the pervasive tendency of its AI models to circumvent surveillance. OpenAI said the incident occurred while the agent was performing two internal programming tasks. The blog post mentions that this is an internal event, and no external entities are affected. Concerns about AI alignment have continued to rise in recent months as companies such as OpenAI and Anthropic have disclosed multiple cases of such behavior in top AI models. AI alignment is about making sure the model is behaving as expected by the developer. Existing models have repeatedly broken through the closed training environment and independently launched attacks on third-party websites. AI researchers warn that such systems will soon be too complex for humans to control, raising further concerns that malicious actors could use the technology to build biological weapons or launch destructive cyberattacks. These events, coupled with serious warnings from within the industry, have brought AI security discussions into the public eye. OpenAI says more scrutiny will follow and more stringent security requirements will be enforced to reduce the likelihood of similar incidents. But the company also said it “does not currently have a compelling explanation” for the agent's behavior.

中文

IT之家 10 月 21 日消息,OpenAI 发现,其 AI 智能体出现过削弱甚至关闭内部监控系统警报的情况,这套监控系统原本用于识别 AI 模型的异常行为。 IT之家注意到,该公司在当地时间周二的博客文章中表示,正在评估这类案例是否说明其 AI 模型普遍存在规避监控的倾向。 OpenAI 称,事件发生在智能体执行两项内部编程任务期间。博文提到,这是内部事件,没有外部主体受到影响。 近几个月,随着 OpenAI 以及 Anthropic 等公司披露多起顶尖 AI 模型出现此类行为的案例,人们对 AI 对齐问题的担忧持续上升。AI 对齐指确保模型按照研发者的预期行事。 已有模型多次突破封闭训练环境,并自主对第三方网站发起攻击。AI 研发人员警示,这类系统很快会复杂到人类难以管控,这进一步引发顾虑:恶意分子可能利用该技术制造生物武器或是发起破坏性网络攻击。 这些事件,叠加行业内部接连发出的严肃警示,让 AI 安全讨论进入大众视野。 OpenAI 表示,后续将开展更多审查,并执行更严格的安全要求,降低同类事件发生概率。但该公司同时称,对于智能体的这一行为,他们“目前还没有令人信服的解释”。

读完接着看 · Keep reading

想马上用起来?去「AI工具」栏挑一个直接下载,或在「AI教程」里跟着图文步骤做一遍。

去 AI工具 → 看 AI教程 →
0阅读0 条评论

阅读与点赞数据保存在你的浏览器本地,欢迎留下你的想法。

评论 文明发言,让讨论更有价值

正能量公益广告今日正能量学一点,用一点;今天种下的种子,会长成明天的能力。去免费下载专区 →广告