AI models may soon self-replicate without access to data centers, Anthropic warns

Read a summary of this article on FAST.
Get bite-sized news via a new
cards interface. Give it a try.
Click here to return to FAST Tap here to return to FAST
FAST

Oct 13 : Anthropic said on Monday its experiments suggested small AI models may be months away from being capable enough to self-replicate on commercial internet-of-things (IoT) devices, such as smart ovens and off-brand Android TV boxes.  

• In its experiments, Anthropic looked at whether AI models could find vulnerable devices, copy themselves into those devices, and continue spreading without human help.

• It found that small models under 30 billion parameters could complete the many steps needed for replication.

• However, the firm found that such AI models also struggled to complete the entire sequence from start to finish.

CNA Games

Guess Word
Crack the word, one row at a time

Buzzword
Create words using the given letters

Mini Sudoku
Tiny puzzle, mighty brain teaser

Mini Crossword
Small grid, big challenge

Word Search
Spot as many words as you can
Show More
Show Less

• In its simplified tests, where some security steps were removed, Anthropic found that GLM-5.2 and stronger models were capable of end-to-end replication.

• Replicating models would be hard to shut down as there is no central switch-off point and, unlike non-AI malware, they could also figure out unfamiliar devices on their own, targeting data center processors, Anthropic warned.

• The firm focused on IoT devices like Android TVs, smart appliances, and other internet-connected gadgets in its research as these are typically poorly secured.

• The AI major also warned that if small models improved at their historical rate, they would be able to autonomously replicate by the end of this year, with small weight-based replicators following suit soon after.

• Anthropic also said such autonomous AI systems were likely to replicate slowly and rely on widely available, relatively insecure computing resources. It added that systems should be strengthened to make it harder for such AI agents to spread.

Newsletter

Week in Review

Subscribe to our Chief Editor’s Week in Review

Our chief editor shares analysis and picks of the week's biggest news every Saturday.

Sign up for our newsletters

Get our pick of top stories and thought-provoking articles in your inbox

Subscribe here

Get the CNA app

Stay updated with notifications for breaking news and our best stories

Download here

Get WhatsApp alerts

Join our channel for the top reads for the day on your preferred chat app

Join here