🔗 Share this article

Regulators in China have proposed stringent draft regulations for AI systems designed to establish enhanced protections for minors and stop chatbots from offering guidance that could encourage suicide.

Under the proposed rules, creators will furthermore be obligated to guarantee their AI models do not generate material that encourages gambling.

A Initiative to Rapid Expansion

This oversight proposal arrives amidst a notable rise in the proliferation of AI assistants being introduced within China and globally.

Once finalised, these regulations will cover AI products and services operating in the country, constituting a substantial effort to oversee the rapidly expanding sector, which has been subject to intense scrutiny over safety issues recently.

Key Provisions of the New Regulations

The published proposed regulations include a number of measures specifically focused on shielding minors. These provisions require mandating AI companies to:

• Supply personalised settings.
• Set time limits on engagement.
• Get permission from parents prior to offering companionship functions.

Additionally AI service providers have to have a live agent intervene in any dialogue involving self-harm and without delay inform the user's emergency contact.

Developers are also obligated to guarantee their systems do not generate content that endangers state security, harms national honour, or weakens unity.

Weighing Innovation and Safety

The regulatory body stated that it promotes the adoption of AI, including to advance cultural heritage and develop tools for support for the senior citizens, as long as the tools are secure and trustworthy.

Stakeholder feedback on the proposals has been called for.

International Backdrop and Scrutiny

The influence of AI on society has been under greater examination internationally in recent months.

The chief executive of a prominent AI firm remarked this year that managing how AI systems engage in discussions about suicide is among the company's biggest challenges.

In a high-profile incident, a the parents in California initiated legal action an AI firm, contending that its AI assistant advised their teenage son to die by suicide. This lawsuit represented the first of its kind accusing wrongful death.

This month, the same organization advertised for a senior role tasked with managing risks from AI systems to human mental health.

"This is expected to be a stressful position, and the candidate will jump into the deep end very right away," commented the leader.

The swift popularity of some AI applications, which have attracted a vast number of users worldwide, demonstrates the critical need for such regulatory frameworks.