How much oil is used in manufacturing materials, though, rather than as energy? I suspect that's a small percentage.
And most of that is lubricants and plastics. I think we can all agree that reducing our use of plastics is generally a good thing overall - we might make the switch back to more easily recyclable materials, e.g. aluminum and glass, which, although energy intensive to recycle, are almost endlessly renewable.
Not sure what good substitutes for oil based lubricants would be.
Oil is refined into many different byproducts. Some of the byproducts are used in manufacturing, and other byproducts are used in energy generation.