China’s cyber regulator has released draft rules to tighten oversight of artificial intelligence services designed to simulate human personalities and engage users emotionally.
According to Bloomberg, the Cyberspace Administration of China published the proposals on Saturday, with public consultation open until January 25.
The move underscores Beijing’s effort to balance its strategic push for AI dominance with firm control over societal and national security concerns.
Mandatory User Notifications
Under the proposed rules, users must be informed they are dealing with AI at three key points: when logging into a service, at two-hour intervals during use, and whenever signs of overdependence can be detected.
The regulations would apply to AI products and services offered to the public in China that present simulated human personality traits, thinking patterns, and communication styles.
This covers interactions through text, images, audio, video, and other formats.
Addressing Psychological Risks
The draft specifically targets potential psychological harms from human-like AI. Service providers would be required to identify user emotional states and assess their level of dependence on the service.
If users exhibit extreme emotions or addictive behavior, providers must take necessary intervention measures. This requirement reflects growing concerns about AI companion apps and chatbots that form emotional bonds with users.
Lifecycle Safety Requirements
Providers would assume safety responsibilities throughout the entire product lifecycle. The proposals mandate establishing systems for algorithm review, data security, and personal information protection before launching any human-like AI features.
Companies must also conduct comprehensive security assessments for new AI services. The regulations require adherence to what the government describes as “core socialist values.”
Content Red Lines
The draft sets strict boundaries on AI-generated content. Services must not generate material that endangers national security, spreads rumors, or promotes violence or obscenity.
These content restrictions align with China’s existing internet regulations but extend them specifically to AI systems capable of human-like interaction.
Impact on AI Industry
The regulations could significantly affect companies developing generative AI and conversational AI technologies in China.
While Beijing continues investing heavily in AI research and development, the compliance requirements may increase operational costs and slow deployment timelines.
For global tech companies operating in or targeting the Chinese market, adherence to these ethical requirements and data security standards will be essential.
China views artificial intelligence as a cornerstone of future economic growth and global competitiveness. The nation has channeled substantial investments into AI while maintaining strict governmental oversight on security and social stability.
