What are people actually doing with all these tokens? I use LLMs pretty heavily for development, and I'm rarely spending all the tokens that come with a $10/month OpenCode Go subscription...
I'm doing lots.
I'm building a social media site that nobody will ever use. I'm printing an ancient game to Linux and expanding the features (such as adding hw acceleration where it isn't needed). I'm troubleshooting crash logs for an Xbox game that has maybe 50 active players. Im building a distributed customer service system that provides LLMs, RAG, tool calls for lots of integrations (Gmail, calendar, sheets) (this one actually has several paying users). I'm building games, and releasing them on the Google marketplace (play store?)
But what used the most tokens was a kind of agent swarm I experimented with to implement a complex desktop application for very specific data manipulation. That.. half worked.. but it's buggy.
I made several internal tools at my company that are actually getting used by pretty much everybody. That's my most successful work I think. Oh, and I created a backup deployment in Azure for my companies product because .. we had the azure credits, so why not?
I write specs and review, but the LLM writes all the code, tests, etc and only gets re-prompted when it screws up badly. That said, I'm not running that many agent loops in parallel, so maybe thats where the cost bites