I’ve been talking to a bunch of companies about how they use LLMs and I’m seeing dramatic differences in costs, with very few concrete measures of value. Mostly just PR counts. We’re talking order-of-magnitude differences in spending, from hundreds up to many thousands. (API pricing, not subscription prices.)

I’m not surprised companies are pulling back. That’s a decent chunk of money and CFOs are going to want to know what they’re getting for the money. “More PRs” isn't a good enough answer.

LOL, I appreciate the boundless optimism.

Or, get this - figuring out what customers really want and need is super hard and churning out code doesn't solve the truly hard problems of software development.

I don't see any indication that LLMs help with requirements gathering or user studies, especially live ones.

Most likely they see no meaningful return on all the money spent on tokens.