Legislation would restrict engagement features and fund research into AI's mental health impact. / IANS
A Democratic lawmaker has introduced legislation that would prohibit artificial intelligence chatbot companies from offering minors features designed to encourage emotional dependence, compulsive use and addiction.
The Addictive Design Act, introduced by Representative Becca Balint of Vermont, would impose civil penalties on companies that make AI chatbots with addictive design features available to young users.
Also read: HSS USA marks America's 250th Independence Day
The proposal comes as more teenagers turn to AI chatbots for emotional support and mental health guidance. According to material released by Balint's office, most chatbots are not designed to respond safely when a young person is experiencing a mental health crisis.
"Technology companies have spent years learning how to capture our attention and keep us engaged for as long as possible. They should not be allowed to apply those same tactics to vulnerable kids who may be turning to an AI chatbot during a mental health crisis," Balint said.
"We can't make the same mistake with AI. We need clear rules, research, and accountability before more families are forced to suffer the consequences," she added.
The legislation would prohibit companies from allowing minors to access chatbots containing features known to increase addiction, unhealthy emotional attachment or compulsive use.
Among the features identified are typing indicators, avatars, storing and using personal information from previous conversations, requiring additional engagement or payment to continue conversations, allowing conversations to last more than two hours, and impersonating a real person.
Companies found in violation could face civil penalties of up to $5,000 for each affected minor.
The bill would also establish an interagency task force to recommend ways to address the mental health risks associated with AI chatbot use among young people. It authorizes $3 million for scientific research and $5 million for outreach programs aimed at helping parents and educators identify warning signs of problematic chatbot use.
Companies would be required to provide relevant data to researchers receiving grants under the program. Refusing to share the required information could result in penalties of up to $10 million.
The proposal also requires companies using age-verification systems to minimize the personal information they collect and delete it within 24 hours.
"AI chatbots should never be designed to keep young people emotionally dependent or endlessly engaged at the expense of their mental health," said Rachel Madley, executive director of the Center for Health and Democracy.
Dr. Marketa M. Wills, chief executive officer and medical director of the American Psychiatric Association, said AI has the potential to improve mental health care but should remain grounded in evidence-based practice.
"AI chatbots should never replace the physician-patient relationship, which remains essential to safe, evidence-based, patient-centered care," she said.
Representatives Chris Deluzio, Tom Suozzi and Bonnie Watson Coleman are co-sponsoring the legislation. Several mental health, social work and consumer advocacy organizations have endorsed the bill.
Discover more at New India Abroad.
ADVERTISEMENT
ADVERTISEMENT
Comments
Start the conversation
Become a member of New India Abroad to start commenting.
Sign Up Now
Already have an account? Login