I have not read GEB but I thought his second book, I am a Strange Loop, did a pretty good job of connecting the idea of self referential loops (like in godels proof) to consciousness and art and such.
Unrusprisingly, since many years went by. But I still love the quirkiness of GEB
(Also, he has other books between the two, I deeply enjoyed Le Ton Beau de Marot, about translations)
Actually, I was recently wondering whether poems can be interpreted as "efficient" computer programs. Words in a sentence/essay just connect different objects in space and time (syntactically and semantically) to form some concept, kind of like a program. A poem just uses higher order abstractions (imagery) to express the same concepts in fewer words.
So this book should be great!