We should have developed command lines with graphics and hypertext. Thus you could do `ls` and double-click on one of the resulting files to open it. Browse the web with wget.
Of course users don't want to learn lots of commands. But notice how Windows 7 onwards and most linux desktops have a "fuzzy search" that really is a kind of command line.
Anyways, if i am to speculate then GUI took over because of discoverability and ease of translation. A CLI is damn hard to translate. With a GUI you change the labels, and thats it. And finding something in a menu or similar was, before programs grew into massive behemoths, simpler than trying to guess what command, for most outside the english speaking world, named in a foreign language, to give to get something done.
I found an example that creates a subwindow and moves it based on keyboard input:
Apart from various experimental support for new mechanisms in various terminal apps, there are two old formats that is supported reasonably widely: ReGIS [1] and Sixel [2]
FWIW, Bloomberg Terminals might be something in line with what you want.