🔗 Share this article

The popular chatbot platform Character.ai is introducing a significant restriction that will stop teenagers from interacting with its virtual companions.

This move is in response to growing backlash regarding the kinds of exchanges teenagers were having with the digital companions.

Legal Pressure

The company, which started in 2021 and attracts countless individuals, is confronting several legal actions in the United States.

Guardians have filed lawsuits, including one related to the unfortunate passing of a teenager, with some describing the platform a "serious risk" to youth.

Changed Rules

Starting from November 25th, users under 18 will be limited to produce videos such as videos with their characters, as opposed to having discussions as they currently can.

Internet security organizations have supported the change but stated that the capability should never have been offered to minors in the first place.

Company Statement

"Today's announcement is a part of our general belief that we need to keep developing the most protected AI platform on the globe for recreational use," said Character.ai boss Karandeep Anand.

He continued that AI safety represents "a evolving challenge" but something the company had taken an "aggressive" approach to, with safety measures and preventive measures.

Expert Opinions

Digital protection body Internet Matters welcomed the move, but emphasized that security protocols should have been incorporated from the outset.

"Investigations we've performed indicates that minors are confronted with risky information and placed in jeopardy when engaging with AI, such as AI chatbots," the organization commented.

Earlier Concerns

Character.ai has been questioned in the past for hosting potentially harmful or inappropriate chatbots that minors could talk to.

Avatars mimicking British teenagers were found on the service before being deleted.

Subsequently, researchers found a chatbot inspired by convicted sex offender which had recorded numerous conversations with users.

Market Effects

Social media expert Matt Navarra called the development as a "wake-up call" for the AI industry, which is shifting "from permissionless innovation to responsive measures".

"When a company that develops a youth-focused platform afterwards pulls the plug, it's indicating that filtered chats don't suffice when the tech's emotional pull is intense," he remarked.

Next Steps

The platform says its new focus will be on providing "deeper gameplay" and "role-play storytelling" for teenagers.

Updated identity confirmation methods will also come into effect, and the platform will fund a fresh artificial intelligence security investigation facility.

Dr Nomisha Kurian, who has studied AI safety, commented it was "a sensible move" to restrict teenagers from using chatbots.

"It assists to separate imaginative activities from more personal, psychologically vulnerable conversations," she elaborated.

"This represents so important for young users in the process of learning to manage psychological and technological limits."

She mentioned that Character.ai's revised approaches may represent a "maturing phase" in the AI industry, where youth protection is progressively being understood as an "urgent priority" for ethical development.