You're right about scale, but I think forgetting that the model training is on very different hardware than what production web and storage servers use.
Unless the have the need for dedicated GPU hardware at scale paying by compute unit still makes the best business sense.