(1) that delta will decrease quickly, and (2) corporations will gladly pay for compute over headcount to maintain fragile data pipelines
The price will go down, but LLMs reaching 100% accuracy and reliability is another story. We are nowhere close right now.
> (1) that delta will decrease quickly
Is your data pipeline o(n^3) in the number of tokens? If not, then no, it won't.
If your problem is compute, you are already optimizing. This is here for all the steps before you start thinking latency-compute. Not all use cases are made equal.