AI (specifically the LLM variety) should be performing small tasks via agents and then using structured output to allow those agents to pass information in a larger system. There, as an example, countless zero/few shot classification tasks that LLMs crush traditional ML at. You want user tickets routed to the correct rep? That sounds like a task an LLM should be doing behind the scenes.
Code gen as an output is likewise boring, agents that adaptably learning to code themselves, generate tests, allow for debugging etc, that has the potential to be very powerful.
Unfortunately I still feel the next AI winter will hit before people even really scratch the surface of how these tools can be used in practice. Everyone is tragically trapped in the prompt -> output model, rather than really thinking about agent based approaches.