For comparison...
A single Google TPUv4 'pod' (entire row of datacenter racks) gives 1,126,400 TFlops.
Thats why your pet ML projects will always be behind those done at big companies.
A single Google TPUv4 'pod' (entire row of datacenter racks) gives 1,126,400 TFlops.
Thats why your pet ML projects will always be behind those done at big companies.
And googles pods have microsecond latency terabit interconnects, while a fleet of macbooks would have hundreds of milliseconds of latency and low bandwidth...
And Google has many pods...
I'm afraid even a massive team of home users will never beat companies with dedicated hardware.
Well ... SETI@home wasn't trying to create ML boobs for anime waifus! ... I suspect the army of young guys that want to do that would dwarf any other distributed service including bitcoin!