> a highly distributed model that can’t be shut down, blocked, centrally programmed, or constrained is the future I’m excited to see

Brushing over the idea that we’d run an ML model on a blockchain like it’s a general purpose computer… we already have a distributed model that can’t be shut down. LLaMA leaked over BitTorrent, and that was used to build Alpaca - and that’s a small model (~4gb) that basically anyone can download and run on any device.

As long as people keep seeding it, then it’ll stay distributed and resistant to being blocked etc. as long as we distribute info like we do today, anyone will be able to train the model (like they did from LLaMA -> alpaca).