Do you also wonder what it gets us to be able to inline pictures in webpages?
Because that is the main benefit: Being able to inline graphics in an otherwise mostly textual interface.
There are a great many situations where I want to work on the command line, and I mostly want to work on text, but occasionally would like to output graphics. X forwarding is great and lets me opt to spawn an image viewer instead, but it's awfully limiting. For starters, it means you have text one place and the image somewhere else, which is fine if they are fully separate, but annoying if the image and text are providing context to each other and especially if you want multiple images. Being able to augment tool output with simple graphics, to me, is of similar utility to syntax highlighting and other colour use in the terminal.
E.g. consider being able to easily list a directory on a remote server and inline thumbnails without having to start a file manager via X forwarding.
I'd loathe for people to start writing graphics heavy applications as terminal apps with graphics, or for people to start requiring a pointing device for them, but there's a lot of small uses that can make the command line a lot more pleasant.