It's fascinating how embedding informational complexity in higher order relationships somehow gives rise to a map of represented concepts that are extendable with new data. Explainable NN models are going to be an absolute necessity - such as in the justice system or if we employ them in autonomous driving.
Tangentially, I don't believe GPT-N will be the way to achieve AGI, however we can learn much on said road travelled.