China Tightens Rules on Human-Like AI Chatbots Amid Digital Companion Concerns

China has tightened regulations governing human-like AI chatbots as the growing popularity of digital companions raises alarms about their impact on mental health, personal relationships and social interaction. The new rules target AI systems designed to simulate emotional bonds with users.

The regulatory push follows concerning incidents. In early 2024, a young man in Huangshi, southeastern China, reportedly posted a farewell message on Douyin before an apparent attempt linked to his relationship with an AI companion. Such cases have prompted Chinese authorities to act more aggressively than most jurisdictions in restricting how AI companies can design and market emotionally engaging chatbot experiences.

The move places China alongside California, where Governor Gavin Newsom recently signed Adam's Law regulating how children interact with AI systems. However, China's approach is broader in scope, applying to adult users as well and reflecting the country's established pattern of intervening early in technology markets that it deems socially destabilising.

For the global AI industry, China's regulations signal that the rapid proliferation of companion AI products — from character chatbots to virtual girlfriends — is drawing serious regulatory attention across major markets. Companies building emotionally engaging AI products may need to invest in safety mechanisms and content guardrails sooner than anticipated.