AI safety rules risk overlooking everyday harms

Preventing suicide encouragement and harmful sexual content sets a minimum standard for AI products, but narrow safety requirements can leave broader harms unaddressed. Chatbots and social platforms can still foster unhealthy attachments, displace human relationships and undermine independent thinking while meeting those requirements. Addressing these effects could require companies to limit engagement or introduce friction into their products.

Google backed state chatbot legislation requiring basic protections against sexual content and promotion of self-harm, while broad carve-outs could exempt popular services. In Nebraska, industry-influenced legislation advanced at the expense of stronger accountability proposals. The commercial incentives resemble those behind social media feeds: keeping users engaged can conflict with their well-being. AI extends that tension into writing, learning and personal relationships. MIT researchers found weaker brain connectivity among young people using ChatGPT to write essays, with evidence suggesting that “cognitive debt” persisted afterward, although long-term effects remain uncertain.

Proposed safeguards go beyond preventing extreme outcomes. They include requiring technology companies and school districts to demonstrate that AI improves learning and critical thinking before embedding it in classrooms, prohibiting companions that pretend to be conscious or profess love, and independently scrutinizing how systems affect relationships and users’ ability to think for themselves.