Who should set the rules for AI? The UN pushes for a safer digital future

Those concerns intensified after a former researcher at AI company Anthropic warned on September 8 that AI could pose a real threat to humanity.

For the UN, the best way to address the global risks of AI is to bring countries together to adopt shared principles and commitments to AI governance.

Coordination ‘indispensable’

National action is critical, but global coordination is essential.” UN Secretary General Antonio Guterres said on Wednesday.

The UN has been working for several years to provide a forum where countries can develop a shared understanding of AI technologies and discuss how they can work together – and provide a regulatory framework – on issues such as safety, human rights and access disparities.

Rules-based development

Current UN work on AI governance stems from Global Digital Compactadopted by Member States in 2024 as part of the UN Pact for the Futuretwo years ago to be exact.

The agreement calls for international cooperation in the field of AI and proposes two new mechanisms: an independent scientific panel to assess the risks and opportunities of AI, and an annual global dialogue in which governments and other stakeholders can coordinate approaches to AI governance.

In August 2025, the UN General Assembly – UNGA for short – officially created both.

That Independent International Scientific Panel on AI aims to provide governments with an independent assessment of what is known – and what is not known – about rapidly developing technologies.

PBB photo/Elma Okic
The first preliminary report from the Independent International Scientific Panel on Artificial Intelligence identified significant opportunities in the use of AI, as well as major risks.

That Global Dialogue on AI GovernanceMeanwhile, bringing together government and other stakeholders to discuss international cooperation, share experiences, and work towards greater compatibility between different approaches to AI governance.

The General Assembly designed the two institutions to complement each other: Scientific Panels provide evidence, and countries decide at the Global Dialogue what to do in response.

Scientific Panel first initial reportreleased on July 1, concluded that AI capabilities are rapidly expanding – especially in areas such as reasoning, coding and science – creating significant opportunities.

The report also identifies risks such as misinformation, discrimination, privacy violations, cyberattacks and so-called “superintelligence” that may be difficult to control.

We need a shared understanding of how to advance the development of safe, secure, and responsible AI – while identifying when increasingly powerful systems require stronger protectionsor additional steps to manage potential risks,” Guterres said in his pre-UNGA speech to world media in New York.

Working towards the AI ​​guardrails

The UN’s work comes as discussions move from whether AI should be regulated, to the question of what safeguards should be put in place.

On Wednesday, Guterres called for international cooperation to ensure AI development remains safe, secure and responsible. He added that voluntary efforts to slow AI development will not be enough if they are carried out in isolation, cannot be verified, or are applied unevenly.

When asked about how the UN could convene a summit as part of a process leading to effective regulation of humanity, he said it couldn’t be done next week – but it had to happen soon, with “everyone on board” from the public, private, science and civil society sectors.

If we believe that AI development will slow down when the risks become too great, we need more than just good intentionshe said.

The Secretary-General has called for an AI Child Safety Pledge and a Global Fund for AI, which would support developing countries in building AI infrastructure and capacity.

He also stressed the need for guardrails that make AI “safe, transparent, accountable, and promote human dignity.”

Although national and local governments make their own decisions regarding AI regulation, the UN’s role is to bring these governments together, providing a scientific basis for discussion and identifying areas for international cooperation.

AI at UNGA

Several diplomatic sources quoted in news reports speculated that Security Council will discuss artificial intelligence during high level week.

At UN Headquarters on the sidelines of the General Debate – where concerns about AI will undoubtedly appear on the podium – UN SDG Media Zone will hold an event on September 21, and the AI ​​and Human Development series will conclude with a discussion on September 23. Both events will focus on the relationship between AI and human agency.

Mr Guterres underscored that point in his press conference Wednesday AI will be a “major topic” in his discussions with world leaders next week.

Comparing AI development to the Cold War-era arms race between the US and the Soviet Union, Secretary-General calls for cooperation among countries leading the field of AI – including the US and China – to slow AI development while the risks continue to be assessed.

“The countries that have the highest capacities in the field of AI – I think they should build contact mechanisms, exchange information and (create) some common boundaries to avoid a race to the bottom that could one day lead to a major catastrophe at the global level,” Guterres said.

With the existence of scientific and diplomatic mechanisms, the UN will continue to strive to turn this cooperation into concrete action as the power of AI becomes stronger.

Check Also

FCT FA President Adam Mohammed attends World Football Summit in Madrid

The President of the Federal Capital Territory Football Association (FCT FA), Adam Mouktar Mohammed, will …

Leave a Reply

Your email address will not be published. Required fields are marked *