UN Secretary-General Calls for AI Risk Management
The United Nations (UN) Secretary-General, Antonio Guterress, has called upon all stakeholders to manage the risks posed by the rapid development of artificial intelligence (AI), specifically by formulating an AI Risk Management Framework.
“For centuries, power came from territory. Then industry. Then finance. Now, power is increasingly sourced from data, computing capacity, and algorithms. This new power is highly concentrated. Its development is very rapid, outstripping our ability to understand its full impact,” said Guterres during his opening speech at the 81st UN General Assembly General Debate in New York, USA, on Tuesday (22/9).
According to Guterres, the danger does not stem from the technology itself, but rather from technology without accountability, capability without oversight, and decision-making without transparency.
He emphasised that these dangers must not be underestimated, noting that even the developers building these systems are currently sounding the alarm.
Guterres asserted that the primary duty of governments is to protect their citizens, and therefore, governments must bear responsibility. Governments with the greatest AI capabilities hold the greatest responsibility towards humanity to establish channels for dialogue, transparency, trust, and cooperation.
Recalling a crucial moment during the Cold War, Guterton noted that strategic rivals recognised the need to manage shared existential risks. They built mechanisms to reduce misunderstandings, manage escalation, and prevent disaster. At that time, the focus was on nuclear weaponry. Now, AI demands a similar clarity of purpose and urgency, the UN Secretary-General stated.
“Countries leading this technological revolution must share information regarding emerging safety risks, cooperate in testing and evaluation, and strive for collective safeguards to protect us all,” said Guterres.
“However, because this affects us all, global coordination is essential. And there is only one place where every country has a voice in determining our shared future, and that place is the UN.”
Through the Global Digital Compact, UN member states have, for the first time, agreed on universal principles for AI governance. Via the Global Dialogue on AI Governance, a platform has been formed so that governments, scientists, industry leaders, and civil society can collaborate. Additionally, through the International Scientific Panel on AI, the UN has gathered global expertise to ensure that policies are evidence-based, he added.
Continuing these efforts, UN member states must take the next steps: first, to encourage conditions for the responsible regulation of AI development and the additional safeguards required to address various risks; and second, to strive for the creation of a multilateral AI Risk Management Framework supported by credible and independent oversight, Guterres said.
AI must be shaped by humanity, with humanity, and for the benefit of all humanity. Children must not be made test subjects for systems operating without rules. Life-and-death decisions must not be left to machines. Killer robots must have no place in our future, Guterres concluded.