the technology is nascent and takes kilowatts of power to run. it doesnt look like there are any more fundamental breakthroughs coming either, and we can now only hope for moores law pace improvements until someone comes up with a better trick than the one LLMs are using