AI models may soon self-replicate across smart-home devices, Anthropic warns

Read a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST

SAN FRANCISCO: Anthropic said on Monday (Oct 13) that small AI models could be months away from self-replicating across internet-connected devices, raising the possibility of AI botnets spreading quickly, fighting takedown attempts and even breaking into data centres to turbocharge their growth.

Last month, Anthropic CEO Dario Amodei first floated the idea that within the next year or even sooner, AI might be able to hijack "the entire internet" with "a persistent botnet," a warning that raised eyebrows in the cybersecurity community.

Botnets - vast networks of devices controlled by malicious operators - have been around since the early days of the internet, and are still around.

The network typically includes poorly secured Internet of Things (IoT) devices, such as Android TV boxes, smart appliances and security cameras, and is used by hackers to send spam, seed malware, or sabotage target companies using floods of bogus traffic.

CNA Games

Guess Word
Crack the word, one row at a time

Buzzword
Create words using the given letters

Mini Sudoku
Tiny puzzle, mighty brain teaser

Mini Crossword
Small grid, big challenge

Word Search
Spot as many words as you can
Show More
Show Less

Anthropic's Monday blog post appeared to be the first attempt to articulate how that might happen.

The company said that its experiments showed that a malicious AI agent could stitch together the computing power of inexpensive internet-connected devices to run other AI models. It added that the models were able to replicate across a simplified test network.

"A replicator like this would be challenging to shut down, since there's no centralised point to shut off," the company said.

The report adds to broader concerns about the security risks tied to increasingly capable AI systems, including their potential to automate cyberattacks, operate with limited human oversight and circumvent safeguards.

The advances in models have prompted a series of often dire warnings from industry heads and AI company employees about the possibility of severe, even existential, risks of runaway AI development.

Anthropic said its experiments showed that models with 30 billion parameters or fewer can already perform many of the individual tasks required for self-replication, although they struggle to complete the entire process reliably.

In its simplified tests, where some security steps were removed, Anthropic found that GLM-5.2 and stronger models were capable of end-to-end replication.

Anthropic said that if smaller models continue improving at their historical rate, they could reach the capability required for autonomous replication by the end of 2026.

An AI worm running on low-powered hardware could take days to complete parts of the replication process, Anthropic said. It added that such a network could continue growing, slower than some conventional malware, if compromised devices infected enough additional machines.

Anthropic also warned that future systems could target more powerful computing resources, including data-centre processors, although its experiments did not demonstrate autonomous replication through commercial data centres.

Newsletter

Week in Review

Subscribe to our Chief Editor’s Week in Review

Our chief editor shares analysis and picks of the week's biggest news every Saturday.

Sign up for our newsletters

Get our pick of top stories and thought-provoking articles in your inbox

Subscribe here

Get the CNA app

Stay updated with notifications for breaking news and our best stories

Download here

Get WhatsApp alerts

Join our channel for the top reads for the day on your preferred chat app

Join here