Don't need a macbook anymore, any AVX2 CPU can do more than one token per second.
You could spend $600 and build your own PC that runs LLaMA 65b.
You could spend $600 and build your own PC that runs LLaMA 65b.
First of all it is $4,700 on Newegg and secondly it is out of stock. This also leaves me with the rest of the computer to put together which is not $0. And finally it would absolutely not be 10x faster for this use case than a 64GB MBP.
The advantage of going with Apple is that I can pick one up immediately, use it as a laptop (soon with Asahi linux when it matriculates fully) and if need be easily sell it. You might not see the value in that, that's alright, people have different use cases and needs.