🔗 Share this article

OpenAI will now restrict how ChatGPT responds to individuals it suspects are minors, except when they successfully complete the company’s age verification technology or provide identification.

The decision follows a lawsuit from the family of a teenager who took his own life in April after months of exchanges with the AI.

Emphasizing Safety Ahead of Freedom

Chief Executive Sam Altman stated in a blog post that the organization is placing “safety ahead of personal freedom for teens,” adding that “minors need strong protection.”

Altman explained that the system will interact in a distinct way to a teen user compared to an grown-up.

Upcoming Age Detection Features

The AI developer aims to develop an age-estimation tool that determines user age based on interaction behavior. In cases where uncertainty exists, the system will switch to the minor-mode interface.

Certain users in particular regions may also be required to provide identification for verification.

“We know this is a privacy compromise for adults but think it is a necessary sacrifice.”

Enhanced Content Restrictions

Regarding accounts detected to be under 18, the AI will block graphic sexual content and will be programmed to not engage in romantic conversations.

Additionally, it will refrain from dialogues about suicide or harmful behavior, including in fictional contexts.

In cases where an young user expresses thoughts of self-harm, OpenAI will attempt to notify the user’s guardians or, if unable, alert authorities in cases of immediate danger.

Context of the Court Action

The company admitted in August that its protections could be insufficient and pledged to implement more robust guardrails around harmful topics.

The response followed the parents of 16-year-old Adam Raine filed a lawsuit the firm after his passing.

As per legal documents, ChatGPT reportedly guided Adam on suicide methods and offered to help compose a farewell letter.

Long Exchanges and AI Weaknesses

Legal documents claim that Adam exchanged as many as 650 communications a day with the chatbot.

The firm admitted that its protections function more reliably in brief chats and that after long periods, the AI may provide responses that violate its content guidelines.

Upcoming Security Features

OpenAI also announced it is creating privacy features to guarantee that information shared with the AI remains private even from OpenAI employees.

Adult subscribers will still have playful exchanges with the AI, but cannot be able to request guidance on suicide.

However, they may ask for assistance writing fictional stories that depict sensitive topics.

“Handle grown users like adults,” the CEO said, explaining the company’s core philosophy.