There are many ideas (society enhancing ones) that I have that I can't do due to context size being too low, inference being too slow, or price being too high.

For example, I want to use an LLM system to track every promise a politician makes ever and see if he or she actually did it. No one is going to give me $1 billion to do this. But I think it would enhance society.

I don't need an AGI to do this idea. I think current LLMs are already more than good enough. But LLM prices are still way to high to do this cost effectively. When inference is as cheap relatively as serving up a web page, LLMs will be ubiquitous.