GEB not just a popular exposition of mathematical logic, the book is quite explicitly about philosophy of mind. In particular, he develops the self-reference stuff so he can draw an analogy to brains and tell us his theory of consciousness. As for support for that claim, he clarified the point of the book in an elaborate preface to the 20th anniversary edition, and that still wasn't enough to get the point across, so he wrote an entire second book ('I am a Strange Loop') to explain his theory of mind again.