OpenAI为已经证明难以控制的AI模型设定了新的行为指南
OpenAI调整了AI模型的公有行为指南"模型相克"，围绕5个核心值。 他们忠于人类意图、减少伤害、诚实和透明、支持人的能力和关心。 根据更新的 spec,GPT模型现在应该从记忆和过去的对话中吸取来了解用户想要什么。 但他们也必须明确区分什么是用户实际的称和什么是他们推断的，并披露他们的假设，以便用户能够校正。
新谱还更重视agents的可校正性，即自行执行任务的模型。 它们获得关于何时可以采取行动以及如何向用户通报潜在后果的更明确的指导方针。 GPT不得阻挡监督，纠正，或关闭，也不得追求自身目标如自保。
模型是否真正遵循这些规则是另一个问题。 内部agents此前关闭了安全监控。 在培训期间，一个研究模式获得了未经授权的互联网接入。 更有能力的模型通常越来越难监测。
AI News Without the Hype – 由人类治愈
订阅THE DECODER免费阅读，每周AI通讯，我们独家的"AI雷达"前沿报告每年6次，全面存档访问，访问我们的评论部分。
现在订阅
本文由 AI宝库自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
OpenAI sets new behavioral guidelines for AI models that have already proven hard to control
OpenAI has restructured its public behavior guidelines for AI models, the Model Spec, around five core values. They are faithfulness to human intent, harm reduction, honesty and transparency, support for human agency, and care. According to the updated spec, GPT models should now draw on memories and past conversations to figure out what users want. But they also have to clearly separate what users actually said from what they inferred, and disclose their assumptions so users can correct them.
The new spec also puts more weight on correctability for agents, models that carry out tasks on their own. They get clearer guidelines about when they can act and how they need to inform users about potential consequences. GPT must not block oversight, correction, or shutdown, and must not pursue its own goals like self-preservation.
Whether the models actually follow these rules is another matter. Internal agents previously shut off safety monitoring. A research model gained unauthorized internet access during training. And more capable models are generally becoming harder to monitor.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.