> "In our evaluations, a 9B model got inference running on 8 of the 9 hardware types we tested... GLM-5.2 and stronger models are capable of end to end replication"

It's funny, the Anthropic post is essentially saying the same thing I read today in a r/LocalLlama thread, but rephrased to make it sound bad.

I think it's great that, very soon, local models will be able to auto-magically install themselves on consumer hardware: to tune and configure inference kernels for whatever weird crap the user happens to have on hand. Making software compatible with diverse hardware used to be a hard problem!