Somebody did it... here we go: https://taalas.com/the-path-to-ubiquitous-ai/

Llama 3.1 8B baked into an ASIC. Expect 1/10th the power requirements, and other savings.

This is one of the reasons I don't believe the "it'll never be profitable" narrative. Just stop training when you think your model's "good enough" and move to custom silicon.