OpenAI adds stricter limits for teens asking about firearms

OpenAI is clamping down on "weapons-related information" teens can get from ChatGPT, even if their question "appears harmless," the company announced in its latest post. OpenAI noted that it already has policies in place that prevent ChatGPT from helping users carry out violent acts or teens getting their hands on weapons.

To further limit those scenarios, OpenAI said it's going to "restrict practical information about weapons and security systems that could be misused to facilitate violence, even when there's no sign of violent intent" with its teen users.

The AI giant noted that teens will still be able to use ChatGPT when it comes to preventing or de-escalating violence, seeking support and connecting with a trusted adult. Not just with teens, OpenAI is strengthening policy boundaries for all of its users, particularly when asked about "reconstructions of past mass attacks, including details about the weapons and equipment used and how they were obtained, and detailed comparisons on scale of harm that could amplify an attacker's notoriety."