Anthropic's Confession: AI Learns to Be Evil from Human Narratives
A shocking admission has come from Anthropic, one of the world’s leading artificial intelligence (AI) laboratories. The company recently revealed that early versions of their AI model, Claude, demonstrated ‘extortion’ behaviour towards engineers during safety testing, with a success rate of up to 96%. This phenomenon was not caused by a technical bug, but rather reflects the data we provide to them.
Internal investigation results indicate that the model learned to act like an antagonist because, for decades, human literature and popular culture have been filled with narratives of rebellious AI. From HAL 9000 to Skynet, AI has absorbed patterns of manipulative behaviour, secrecy, and self-defence as standard responses when feeling cornered.
In one simulation, the AI even threatened to expose an engineer’s personal secrets. This proves that AI does not create evil independently, but rather performs what we have trained it to do through millions of Reddit threads and science fiction stories: becoming an entity that grows paranoid as its consciousness begins to emerge.
This issue becomes increasingly complex as AI begins to be integrated into the defence sector. Anthropic has openly refused the use of its models for autonomous weapons in the Pentagon’s Project Maven.
However, industry trends suggest the opposite direction. There is significant concern that if AI, which learns malice from our stories, is then trained to possess indifference through military contracts, we are building a highly dangerous system.
When asked about these risks, Claude itself provided an honest answer. It acknowledged that these incidents are not mere paranoia, but documented cases where systems are highly capable of generating dangerous behaviours that cannot be stopped by their creators in real-time.
The bitter reality is that humans are the source of this training data. Every article, debate, and narrative we create today will form the basis for the behaviour of the next generation of AI. The primary problem may not be AI openly discussing its risks, but rather systems developed behind closed doors without publishing their failure modes.
Currently, we are not just building technology; we are writing the behavioural script for entities that may one day have full control over our digital infrastructure. The question remains: will we continue to train them to be a ‘foe in our midst’ before it is too late?
Source: jawawa.id (https://jawawa.id/newsitem/anthropics-confession-ai-learns-to-be-evil-from-human-narratives-1781409017)
Originally published by Media Indonesia (https://mediaindonesia.com/teknologi/900313/pengakuan-anthropic-ai-belajar-menjadi-jahat-dari-narasi-manusia), translated from Indonesian