China's cyberspace regulator has introduced groundbreaking rules governing AI companions that simulate romantic or familial relationships, making the country the first major jurisdiction to directly address this emerging technology.
The Cyberspace Administration of China (CAC) issued guidelines requiring AI companion platforms to implement content safeguards and prohibit certain functionalities. The rules target immersive tools that create simulated emotional bonds between users and AI systems, particularly those marketed to vulnerable populations like minors and the elderly.
Key provisions include mandatory age verification systems, restrictions on romantic or sexual content involving minors, and prohibitions against encouraging emotional dependency. Platforms must disclose clearly that interactions occur with artificial intelligence and cannot simulate family relationships with minors. The CAC also mandates that operators implement complaint mechanisms and remove content violating the standards within 15 days of notification.
This regulatory move reflects growing concerns about psychological harm. Critics warn that AI romantic companions can foster unhealthy attachment patterns, particularly among isolated users. Mental health professionals worry these tools may delay people from seeking genuine human connection or professional support for loneliness and depression.
The Chinese rules arrive as similar products proliferate globally. Companies operating AI companion apps in Europe, North America, and Southeast Asia currently operate with minimal oversight. The European Union's AI Act addresses some algorithmic risks but does not specifically target emotional simulation technologies. The United States has not enacted comprehensive federal regulation of AI companions, though some state legislatures have begun exploring restrictions.
Industry players argue the technology serves legitimate purposes, helping isolated individuals access companionship and reducing stigma around loneliness. Operators emphasize user autonomy and the voluntary nature of these interactions.
The practical impact remains uncertain. Enforcement mechanisms for the Chinese rules have not been fully detailed, and compliance timelines for existing platforms remain unclear. The regulations may influence regulatory approaches elsewhere as jurisdictions grapple with balancing technological innovation against public health concerns.