I watched someone at a fortune 20 company get embarrassed for buying a Mac to run a 70B model in 2025.
He was a lead engineer, so after he announced it wasn't going to work, everyone pretended it never happened. But we all knew.
He was a lead engineer, so after he announced it wasn't going to work, everyone pretended it never happened. But we all knew.
Also the entire purpose of them buying it was so the department had a LLM.
I proposed A6000. That ended up working.