Otherwise you are right the really big problem right now is that we don't have a suitable replacement for oil that wont also change society in ways nobody is willing to deal with yet.
Fission is not going to be small and safe enough to really replace oil, fusion does not yet exists in the real world, so were probably stuck with renewable untransportable energy infrastructure for any future growth.