Inference costs absolutely did fall. And even more so when looking at intelligence it buys you.

eg compare say gpt 3.5 to latest deepseek. Both cheaper and more at more capable