That's a fine attitude for applied ML, but aren't you even a little bit interested in why these things work so well? It's not obvious.
Tangentially, I don't believe GPT-N will be the way to achieve AGI, however we can learn much on said road travelled.
This is not looking to be the case right now.. Companies are doing quite well without explainable models. SDC companies like Waymo are hoping it will be sufficient to:
1. Produce a low failure rate estimate, based on millions of virtual miles/fake cities.
2. Combine several NN outputs in a logical way. That way there are at least some interpretable values that lead to the result. e.g. a separate model that produces candidate trajectories of surrounding vehicles, one to perceive sensor input, one to plan, etc.