I was a big proponent of AGI and was looking forward to singularity till I started doing psychs and discovered Non-dualism. Now I believe that we cannot talk about AGI till we figure out what consciousness is. There is a huge on-going debate about consciousness and it's origins. In the Materialist-reductionist paradigm, consciousness is considered to be an emergent property of matter. In the Panpsychist paradigm, both matter and consciousness are considered as fundamental and existing separately from each other. In the Non-dual paradigm, consciousness is fundamental and matter is a created by it. I firmly fall into the Non-dual camp. I don't think AGI will ever have an ego as it is not programmable or evolvable. Ego is a product of consciousness, not vice versa. And without ego, you cannot have sentience.