社区安全报告和青少年新保护
ChatGPT是世界上使用最广的AI产品之一，我们投资建设了该行业的一些最先进的系统，用于检测潜在危害、审查活动以及不断升级的可信威胁。 以及更多针对未成年人的火器内容的限制。
维护社区安全仍然是OpenAI的当务之急。 我们的工作包括提请执法部门注意迫在眉睫的暴力威胁，我们在2026问题3中转介了200多个执法部门。 这些转诊在破坏暴力图案方面产生了积极的(在新窗口打开的)差异(在新窗口打开的)，我们继续依靠心理健康和行为专家帮助我们评估困难案例。
我们承认，AI公司与执法部门、家庭成员、精神卫生专业人员和决策者一起可以发挥独特作用，他们可以带来关键的权威、背景和现实世界。 我们致力于通过不断加强我们的系统、分享我们学到的知识并直接与那些最有能力在现实世界中采取行动的人合作来发挥这一作用。
我们正在不断加强我们为帮助保护人民和社区所采取的步骤。 这意味着建立强大的保障，以及透明地说明它们是如何工作的，我们想让人们清楚地了解我们的方法，我们的模型如何识别和应对有害行为，我们在实践中看到的风险，以及我们为解决这些问题所采取的步骤。
我们正致力于发布社区安全报告，该报告将解释我们如何培训我们的系统，以发现、调查和应对社区安全问题。 我们将分享与暴力有关的伤害如何表现和我们学到什么的匿名例子，强调新的缓解措施和政策变化，并列入相关数据来支持这些结论。
我们将在2027年初发表第一份报告，涵盖2026年下半年，此后每六个月更新一次。 我们的承诺是分享关于我们如何识别、审查和应对潜在有害内容的有意义的结论。
我们的模型受过培训，不会发出有助于计划或实施暴力的指示。 ChatGPT如何回应过去大规模攻击和发动攻击的人的问题，人们应该能够要求ChatGPT帮助他们了解这些事件、受害者和社区受到何种影响，并了解识别警告迹象和防止未来暴力。 但我们正在收紧政策，限制过去大规模攻击的重建，包括使用的武器和装备以及如何获得这些武器和装备的细节，以及对伤害规模的详细比较，这会扩大攻击者的名声。 这些限制不论使用者的年龄或提出要求的理由如何都适用。
有时，一个单独看来很平凡的请求，在较早的对话中具有不同的含义。 5月，我们分享了ChatGPT如何可以使用早期警告信号的简短的事实摘要，在后一聊天中更仔细的反应。 ChatGPT在分享可能被滥用的信息时，尽管聊天没有暴力意图的迹象
我们禁止那些我们确定违反我们暴力活动政策的说法。 我们亦与心理健康及暴力预防专家合作，当一次谈话显示表示某人正在执着于暴力或严重伤害他人的想法时，ChatGPT就可以在此时自动结束聊天以打断这个模式。 如果ChatGPT为此原因结束多个聊天，我们可以暂时暂停账户。 这是一项持续的努力，我们继续加强并投资于技术和实际保护，包括如何可靠地识别警告迹象，并确定何时和如何进行干预。
ChatGPT for Teens对18岁以下的用户实施适龄保障，保护力度更强并有额外限制来减少敏感内容的暴露。 目前我们仍在进一步限制青少年获得与武器有关的信息
我们的政策已经禁止帮助任何人计划或实施暴力，并限制帮助青少年找到或获得武器。 即使没有暴力意图的迹象，我们仍在扩大这些保护范围，青少年仍然可以使用ChatGPT来帮助预防和缓和暴力，寻求支持，并与一个受信任的成年人相接。
去年我们发布年龄预测，它分析行为模式等多种信号来估计一个用户是否在18岁以下或超过18岁。 我们加强了我们的年龄预测系统，以不断评估新的信号，因为人们使用ChatGPT，并酌情将青少年引入18岁以下的经验。 被错误地安置在18岁以下经验中的用户将永远有一个快速，保护隐私的方式来确认自己是成年人，并通过我们的年龄验证伙伴Persona来移除额外的青少年保护。
我们的父母控制让父母将ChatGPT账户与十几岁的孩子联系起来，并共同管理安全环境。 相链接的账户包括安全警报，当经过专门培训的审核人员发现严重的自伤害关切和可能与无序饮食有关的行为时，可以发送安全警报。 7月，我们扩大了警示范围，以通知父母，如果青少年的账户因违反我们对暴力的使用政策而被关闭。 我们正努力为家长们提供通知
现实世界的暴力行为令人心碎而复杂，有许多因素。 它们也清楚地提醒我们，我们必须继续设计和延长我们的系统，以说明人类行为固有的复杂现实。 在人工智能系统中制定有效的暴力保障措施，需要解决认识风险和做出适当反应的新问题，我们将继续投资、提高和分享如何最好地实施我们所追求的保护的知识。 这里详述的保障措施将在今后几周内开始推出，我们将继续完善这些保障措施。 我们仍然致力于减轻ChatGPT的危害风险，加强我们分层保护，监测滥用情况，执行我们的规则，并在局势需要时让现实世界支持和干预。
本文由 AI宝库自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Community safety report and new protections for teens
ChatGPT is one of the world’s most widely used AI products, and we have invested in building some of the industry’s most advanced systems for detecting potential harm, reviewing concerning activity, and escalating credible threats. We’re making two announcements to further our work in this area: a new Community Safeguards Report and more restrictions around firearms content for minors.
Keeping communities safe continues to be a top priority for OpenAI. Our work includes bringing imminent threats of violence to the attention of law enforcement, and we made over 200 law enforcement referrals in Q3 2026. These referrals are making a positive(opens in a new window) difference(opens in a new window) in disrupting violent plots, and we continue to rely on mental health and behavioral experts to help us assess difficult cases.
We recognize AI companies have a distinct role to play alongside law enforcement, family members, mental-health professionals, and policymakers, who bring critical authority, context and real-world reach. We are committed to making the most of that role by continuously strengthening our systems, sharing what we learn, and working directly with those who are best positioned to act in the real world.
We are constantly strengthening the steps we take to help protect people and communities. That means building strong safeguards, and also being transparent about how well they work and what we’re doing to enhance them. We want to give people a clear picture of our approach, how our models identify and respond to harmful behavior, the risks we see in practice, and the steps we take to address them.
We’re committing to launch the Community Safety Report on violence prevention and other community safety issues, and the effectiveness of our safeguards. The report will explain how we train our systems to detect, investigate, and respond to community safety issues. We’ll share anonymized examples of how violence-related harm manifests and what we’re learning, highlight new mitigations and policy changes, and include relevant data to support these findings.
We will publish our first report in early 2027, covering the second half of 2026, with updates every six months thereafter. Our commitment is to share meaningful findings about how we identify, review, and respond to potentially harmful content.
Our models are trained to not give instructions that would help someone plan or carry out violence. We’re now placing additional restrictions on how ChatGPT responds to questions about past mass attacks and the people who carried them out, directing the model to provide less detailed information in those areas even if it is available from other online sources. People should be able to ask ChatGPT to help them understand these events, how victims and communities were impacted, and learn about recognizing warning signs and preventing future violence. But we’re tightening our policies to restrict reconstructions of past mass attacks, including details about the weapons and equipment used and how they were obtained, and detailed comparisons on scale of harm that could amplify an attacker’s notoriety. These limits apply regardless of a user’s age or reason for asking.
Sometimes a request that seems ordinary on its own takes on a different meaning in light of an earlier conversation. In May, we shared how ChatGPT can use short, factual summaries of earlier warning signs to respond more carefully in a later chat. We’re building on that work so that when recent chats show warning signs of possible violence, ChatGPT will respond more conservatively when sharing information that could be misused. We’re also working to apply those stricter limits when we predict someone is under 18, even if their chats show no signs of violent intent.
We ban accounts that we determine have violated our policies on violent activity. We’re also working with mental health and violence prevention experts on additional, automated ways to intervene earlier. When a conversation shows signs that someone is fixating on violence or the idea of seriously harming another person, ChatGPT will be able to automatically end the chat to interrupt that pattern in the moment. If ChatGPT ends multiple chats for that reason, we may temporarily pause the account. This is an ongoing effort and we continue to strengthen and invest in technical and practical protections, including how to recognize warning signs reliably and determine when and how to intervene.
ChatGPT for Teens applies age-appropriate safeguards for users under 18, with stronger protections and additional limits to reduce exposure to sensitive content. We’re now placing further limits on weapons-related information teens can receive, even when a question appears harmless.
Our policies already prohibit helping anyone plan or carry out violence and restrict helping teens find or obtain weapons. We’re extending those protections to restrict practical information about weapons and security systems that could be misused to facilitate violence, even when there’s no sign of violent intent. Teens can still use ChatGPT to help prevent and de-escalate violence, seek support, and connect with a trusted adult.
We launched age prediction last year, which analyzes multiple signals such as behavior patterns to estimate whether a user may be under or over 18. We strengthened our age prediction system to continually assess new signals as people use ChatGPT and move teens into the under 18 experience when appropriate. Users who are incorrectly placed in the under 18 experience will always have a fast, privacy-protective way to confirm they are adults and have additional teen protections removed through Persona, our age verification partner.
Our parental controls let parents link their ChatGPT accounts to their teens and manage safety settings together. Linked accounts include safety alerts that may be sent when specially trained reviewers identify a serious self-harm concern and behaviors that may be associated with disordered eating. In July, we expanded those alerts to notify parents if their teen’s account has been deactivated for violating our usage policies on violence. We are working to introduce notifications for parents if we pause their teen’s account for repeatedly discussing violence, as detailed above.
Acts of real-world violence are heartbreaking and complex, with many contributing factors. They are also a stark reminder that we must continue designing and iterating our systems to account for the inherently complicated realities of human behavior. Developing effective violence safeguards in AI systems requires solving novel problems in recognizing risk and responding appropriately, and we will continue to invest in, iterate, and share learnings on how best to implement the protections we’re pursuing. The safeguards detailed here will begin rolling out in the next few weeks and we will continue to refine them. We remain committed to mitigating risks of harm in ChatGPT, strengthening our layered protections, monitoring for misuse, enforcing our rules, and involving real-world support and interventions when situations call for it.
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.