Not convinced that is true, if the universe can be described mathematically then maybe human intelligence can also be written down as some equation on a sufficiently big piece of paper.
Yes, I know that what I'm hinting at is not falsifiable, burden of proof, etc.
But I think it's a little arrogant of us as a species (nb, I'm not talking to you, sgillen, in particular) to think that since we've come as far as we have, that the mysteries of consciousness and life and the universe and everything are going to be laid bare Real Soon Now.
The answer is certainly not obvious to me, especially when we have results such as Goedel's theorems.
But there’s also no reason this is required for consciousness to be emergent from non-human-brain systems.
I think one of the hard parts of theory of mind is that we probably will never understand the experience of being in things sufficiently different from ourselves. Any computer system will probably be sufficiently different, so we can’t know what it’s like to be an AI.
What’s it like to be a chatbot?