I enjoyed the feeling when I made this connection talking with a startup doing this a while back. It's just a different "language" and although it's not a given that LLMs can operate in it, it's a reasonable thing to try, and it turns out they can.
I suspect we will need to move from sequential modelling to graphical modelling to level-up again, though.
Out of curiosity, would you mind elaborating on this?
it could also be I completely misunderstand context in sequential models and what I'm describing is already being used, or has been evaluated and has been unsuccessful.