Microsoft CEO Says AI Models Need an ‘Emergency Brake’

Jakarta (ANTARA) – Microsoft CEO Satya Nadella said artificial intelligence (AI) systems need control mechanisms that allow authorised parties to pause or shut down a model while it is carrying out a task.

In a post on X on Saturday morning, Nadella said it was time to reconsider the trust architecture of AI systems.

“We cannot treat Super Intelligence as a set of nested black boxes and simply accept or reject their recommendations, answers and actions,” Nadella wrote, using the term chosen by the Trump administration for AI, as quoted by TechCrunch on Saturday (10 October).

He also called for every consequential action taken by a model to be documented with evidence that is readable by humans and cannot be manipulated. In addition, systems should allow authorised people to pause or shut down a model in the middle of a task.

“We must assume that a model has been compromised and isolate it from the outset,” he said.

Nadella’s comments came as leading AI companies acknowledged a growing number of incidents in which they appeared to lose control of the models they had developed.

They also followed Anthropic CEO Dario Amodei’s publication of a plan for a more cautious approach to AI development.