Hacker News Reader

Maybe the idea is not to have the whole model but the executer so … by copying an API key?

https://www.anthropic.com/research/self-replicating-ai

By chaining several devices

You should read the report, it is interesting technically if you ignore the fear-mongering. It distributes the model's layers over multiple compromised devices.

And considering typical WAN latencies of 20+ ms, what’s the expected inference rate, 1 token per month?

Maybe I did something wrong or unaware about the tricks to make it fast, but last time I tried to play with exo and distribute processing over a few home LAN computers to see if I can run models that don’t fit my 3090, the penalties were brutal.

0.5 tok/s I think is their claim. Basically skynet