Local models cost more imho.

I acknowledge all the pros of local models but even if i maxxed out the 50 tokens/s over a month there’s no way I’m ever repaying the hardware costs. It’s not what local models are for.

So a strange article to talk of financial trap of tokens and then advocates for local models. A pay by the token plan capped at the same 50tok/s would always be cheaper per month than the amortised cost of the local model. Assuming you compare small model to small model.