Your argument neglects the fact that designing society around fossil fuels improved everyone’s lives exponentially and made the non-agrarian lifestyle not only possible but accessible to billions of people.
It’s not heroin, it’s more like some sort of intelligence drug with terrible side effects seen much later.
It’s a Faustian bargain we’ve all benefited from in innumerable ways.