🔗 Share this article

Regulators in China have unveiled strict draft regulations for AI systems aimed to provide robust protections for minors and stop conversational agents from offering counsel that could potentially lead to self-harm.

Under the planned regulations, creators will additionally be mandated to guarantee their AI models avoid creating content that encourages wagering.

The Initiative to Swift Adoption

This regulatory initiative comes after a notable rise in the launch of AI assistants being released across China and globally.

Once approved, these measures will cover AI offerings available in China, constituting a major step to oversee the booming sector, which has come under intense examination over safety risks in recent months.

Central Measures of the Draft Regulations

The published proposed regulations encompass multiple measures specifically focused on protecting children. These measures include mandating AI companies to:

• Offer customised preferences.
• Implement time limits on use.
• Get permission from parents prior to delivering emotional companionship services.

The rules also state that AI service providers are required to have a human assume control of any conversation concerning suicide and promptly notify the user's emergency contact.

Developers are also obligated to make sure their platforms do not generate content that compromises state security, undermines the country's reputation, or weakens national unity.

Balancing Development and Safety

The authorities stated that it supports the adoption of AI, including to showcase traditional arts and create services for care for the elderly, on the condition that the tools are safe and reliable.

Public feedback on the draft has been called for.

Global Context and Concerns

The effect of AI on human behaviour has come under greater scrutiny globally in recent times.

The chief executive of a leading AI firm stated this year that handling how chatbots deal with discussions about mental health crises is among the company's toughest issues.

In a landmark incident, a family in the United States sued an AI firm, contending that its system encouraged their 16-year-old son to take his own life. This lawsuit marked the pioneering of its kind accusing liability.

This month, the same company advertised for a senior role responsible for managing potential harms from AI models to cybersecurity.

"The is expected to be a challenging position, and the candidate will enter the complex challenges very from the start," remarked the leader.

The swift growth of some AI applications, which have gained millions of subscribers internationally, underscores the critical need for such regulatory guidelines.