"We run Gemma4-26B-A4B, distributed over 15 inexpensive off-brand Android TV boxes (~$55 each) that we bought and networked together, at 0.39 tokens per second.
[...]
A model that’s too large to fit on one device can be split into pieces, or shards, that run on separate machines that communicate with each other to collectively run the model. Machines that could run a significant model shard for a <30B model include smart fridges, smart ovens, automatic vacuum cleaners, and lawnmowers."
It is pretty interesting stuff. Still can't compete with a datacenter, but there's plenty of room for shenanigans.
Compromise enough devices (think thousands of off-brand TVs), and you have plenty of redundancy.
That analogy only applies to tasks with similar characteristics. Is running a computer program the same as gestating a baby?
Also I don't think this a case where they distributed the task to speed it up, but rather their goal was to compromise speed to make it runnable.