People aren't freaking out because self-hosting isn't a solve issue and it requires a lot of capital. The average company won't go and build an $1M GPU cluster just to self-host any model. If that gets commoditized then they'll start freaking out.
I have deployed multiple setups with 2/4/8 x H100/200 to do data entry with LLMs at big companies. Trillions of tokens already inferenced ok those. The starting price is about 100k.