China Proposes Ban on "Virtual Intimacy" for Minors
China's primary internet regulatory body has outlined new proposals to manage how online platforms and game developers interact with underage individuals. These rules include a prohibition on offering "virtual intimacy services" to users under 18, addressing the increasing popularity of artificial intelligence-powered companions. The move aims to protect minors from potential addiction and harm, a growing concern for authorities.
The proposed regulations, titled "Ensuring minors' safe and healthy use of the internet", specifically forbid online platforms from providing "virtual relatives or companions". Operators will also be prohibited from offering services that could "induce minors to become addicted or otherwise harm or may seriously affect their physical and mental health", according to the document published by the Cyberspace Administration of China. This directive reflects a broader governmental effort to safeguard the well-being of young internet users.
The document details a ban on online social networking services between strangers, with an exception for those aged over 16 who earn their own income. Platforms must also activate a dedicated minors' mode for online games, social sites, and AI services impacting the cognition of users under 16. And operators are required to accurately identify underage users, preventing algorithms that might foster emotional dependence, addiction, or excessive spending.
Violations of these forthcoming regulations could result in significant financial penalties. Fines may reach up to 10 times the income generated by the platform, particularly if earnings surpass USD 149,000. In severe cases, all associated income could be confiscated. These proposals mark another step in the regulation of screen time for young people across the country.
Teenagers, specifically those aged between six and 19, constituted 18 percent of all Chinese internet users as of a period late in the previous year. This equates to 112.5 million individuals, according to data from the state-run China Internet Network Information Centre. He Qianggao, a lawyer and director at Geason Law Offices, commented on the definitions within these regulations. But he clarified that the core issue in defining a "virtual intimate relationship" lies in whether a service is designed to simulate or replace real family or partner relationships, building sustained emotional bonds through character settings and emotional guidance.
Mr Qianggao further explained that general AI chats or functional role-playing activities would likely not fall under this new scope. However, services that actively promote emotional dependence or function as substitutes for real-world relationships could face scrutiny, even if they are not overtly marketed as AI companions. This presents a considerable compliance challenge for AI developers operating within the jurisdiction.
Companies in the artificial intelligence sector face challenges beyond simple age verification, needing to determine appropriate service access for identified minors. This expanded requirement will probably lead to increased operational costs across product design, technical infrastructure, and compliance assessments. So these new proposals follow general rules introduced a few months prior.
The current proposals emerge some months after China implemented its initial rules for humanlike AI interactions, which became effective earlier this year. These earlier regulations specifically addressed AI systems designed to excessively cater to users or to encourage emotional dependence, especially in ways that could detrimentally affect real-world relationships. This prior regulatory framework set a precedent for the latest measures.
In response to these earlier measures, companies such as ByteDance, with its Doubao platform, and Alibaba Group Holding, with its Qwen service, made adjustments to their offerings. Both entities subsequently disabled their customised agent functions. These functions previously allowed users to create digital characters with predefined names, distinct personalities, and particular speaking styles. According to the South China Morning Post, Alibaba Group Holding is the parent company of this publication. The proposals are currently open for public comment for a defined consultation period.
China's internet regulator has drafted new rules to protect minors from AI companions.
The proposals include a ban on "virtual intimacy services" for those under 18.
Online platforms are prohibited from offering services that induce addiction or harm minors.
Violations may result in significant fines and confiscation of income.
Industry experts anticipate increased compliance costs for AI companies.
Source: SCMP
