I'm not clear on what you're missing. What meme? The protocol is well documented. The basic abstraction is that there is a separation between the 'processing' part of an application and the 'display' part of the application and those two parts communicate using the X11 protocol. That conversation can happen over a local or a remote socket, or shared memory. The practical use cases are that I can have an application running on my local machine, or one on the other side of the world, and the 'display' portion is consistent. Not much different than, say how Citrix uses it's own protocol to draw remote displays.
It allowed a 'mainframe' model where you could have a very fast, expensive application servers that could display to less expensive local resources, and mix the display with local applications. So my heavyweight applications could run on the monster Sun or Cray in the datacenter, but my clock, calc and notepad app ran locally, but all in the same display.
Yes, over the years things like MIT-SHM and NX came along to paper over problematic issues in X11. And yes, there are other, possibly better ways so solve it now. But in the late 80s and through the 90s, it was pretty cool stuff.