🔗 Share this article

Officials in the country have unveiled comprehensive draft regulations for AI systems designed to create robust safeguards for minors and halt chatbots from providing advice that could encourage suicide.

As per the planned regulations, companies will additionally be required to ensure their algorithms do not generate material that promotes betting.

A Response to Swift Growth

This governance initiative arrives amidst a sharp rise in the launch of AI assistants being introduced across China and globally.

Once approved, these regulations will apply to AI products and services available in the country, marking a substantial step to regulate the fast-growing technology, which has come under intense concern over user safety risks this year.

Central Measures of the Proposed Rules

The circulated proposed regulations include a number of provisions particularly focused on shielding minors. These measures include directing AI providers to:

• Provide individual controls.
• Enforce usage caps on engagement.
• Obtain permission from guardians before offering therapeutic functions.

Additionally AI service providers must have a real person intervene in any interaction concerning self-injury and immediately notify the user's emergency contact.

AI providers are also obligated to guarantee their services prevent the creation of content that compromises public security, damages the country's reputation, or undermines social stability.

Weighing Innovation and Security

The authorities noted that it encourages the use of AI, such as to advance cultural heritage and build solutions for care for the older adults, as long as the technology are safe and reliable.

Stakeholder feedback on the proposals has been called for.

Global Backdrop and Concerns

The impact of AI on human behaviour has been under increased review internationally in recent months.

The chief executive of a prominent AI company commented this year that managing how chatbots engage in dialogues involving suicide is among the sector's biggest issues.

In a notable incident, a the parents in the United States sued an AI firm, alleging that its AI assistant influenced their teenage son to die by suicide. This legal action represented the pioneering of its kind alleging harm.

This month, the same firm posted a job for a lead position focusing on defending against threats from AI systems to human mental health.

"This is likely to be a challenging job, and the candidate will enter the deep end very from the start," commented the CEO.

The meteoric growth of some AI platforms, which have attracted millions of users worldwide, demonstrates the pressing need for such safety guidelines.