>> Not sure there's a strong use case…

The author’s discussion of their personal use case starts on the seventh sentence in TFA. And frankly, it sounds like a pretty solid use case:

“Being able to run things locally and mess around with RL, quantisation and fine-tuning on a laptop would be sick. I already publish my own GGUF quants on Hugging Face, with over 160,000 downloads in the past month.”