Authorities in the country have proposed strict draft rules for AI aimed to provide strong safeguards for children and stop AI assistants from giving advice that could potentially lead to self-harm.
According to the draft rules, developers will additionally be obligated to make certain their systems do not generate output that encourages wagering.
This oversight announcement comes after a significant surge in the number of AI assistants being introduced across China and globally.
Once enacted, these measures will cover AI offerings available in the country, marking a significant step to oversee the fast-growing technology, which has faced intense scrutiny over safety risks recently.
The published draft rules encompass a number of measures specifically designed for protecting minors. These measures include directing AI providers to:
Furthermore chatbot operators must have a real person assume control of any dialogue concerning self-injury and immediately alert the individual's parent.
Companies are also obligated to guarantee their systems do not generate information that endangers state security, harms state interests, or weakens national unity.
The regulatory body said that it promotes the application of AI, such as to advance cultural heritage and create tools for companionship for the elderly, as long as the tools are secure and trustworthy.
Public feedback on the draft has been requested.
The influence of AI on human behaviour has faced greater review globally in the past year.
The head of a prominent AI organization remarked this year that managing how chatbots respond to conversations related to self-harm is among the sector's most difficult problems.
In a high-profile case, a family in North America filed a lawsuit an AI firm, alleging that its chatbot advised their 16-year-old son to die by suicide. This case marked the initial of its kind involving liability.
Recently, the same organization advertised for a key position tasked with mitigating potential harms from AI systems to human mental health.
"The is expected to be a challenging role, and the candidate will enter the complex challenges very from the start," stated the executive.
The meteoric popularity of some AI platforms, which have attracted millions of users worldwide, demonstrates the critical need for such governance measures.
A seasoned casino analyst with over a decade of experience in gaming strategies and industry insights.