Solar/storage will certainly power a geothermal heat pump, replacing an oil burner that would otherwise burn ~diesel. Or a car that would otherwise burn gasoline (modulo the long timeline of capex).
Yes, there are definitely fundamental engineering constraints when it comes to renewable energy sources. Which is exactly why it makes sense to encourage tackling all of the low hanging fruit we can, rather than continuing to waste limited dinosaur juice out of convenience or inertia.
Politically, it's awfully hard to separate past government action and actions by mutually-acting companies, from current government policies. Biden got politically pinned with the price inflation that happened due to all the monetary inflation of the Trump administration. The brazen consumer price inflation that started happening a year+ ago seems to have been kicked off by a bunch of news articles announcing it, etc. The narrative about approving new drilling leases seems like it has nothing to do with current extraction rates, and everything to do with fossil fuel companies wanting to title up the public commons now, for use in the future.