Accounting for initial acquisition cost and typical depreciation/failure rate? I assume they already consider colo price, electricity, etc
You can well imagine if you own your infra and can make utilization over 90%, where these go.
And then, my link above is for K3 model, which, compared to ds flash models, is highly unoptimized.
If I had a few million lying around, I would have invested in inference.