I stumbled across a creator on Tiktok who knows a lot about the oil and gas industry [1] who has been illuminating (to me at least) about what's been going on here.
Here's my summary: we haven't had a shortage of oil production although that was off its peak. The real problem was a lack of refining capacity that was caught off-guard by this year's massive increase in demand. There are a bunch of reasons for this. Some capacity was lost due to a hurricane. Other capacity was offline as certain plants were being transitioned to a renewables future when the demand was lower and it wasn't anticipated it would return so strongly and quickly.
Have Exxon, Chevron, etc made bank with the spike in prices? Absolutely. If you want to propose something like what Spain has done with a windfall tax to fight inflation (something no politician in the US talks about) then I'm on board.
But you can't just turn on an oil well or a refining plant. It takes time. Oil companies, for all the heinous crap they have done, antiticpated this demand spike was temporary better than any politican has.
On the political side you see Democrats desperate for prices to go down so they get slaughtered less in the midterms and Republicans desperate for this not to happen for the inverse reason (eg Republicans wanted to stop selling oil from the SPR).
But the warning signs of this price drop coming were evident months ago as inventory levels of gasoline started to go up.