It will not. The only way to reduce prices of oil/gas and fertilizers (for food) is to bring back the amount of oil/gas and ammonia that went offline due to Russia. There is no amount of digging anywhere in the world that will quickly replace this much lost natural resource.
What raising interest rates will do is cause less spending in all non-oil/gas goods and services. This means every other industry must expect a reduction in revenues because the average customer is going to be spending more on oil/gas and food.
In other words, the choices for companies are: be ok with reduced revenue or be ok with reducing prices.
The choices for individuals are: be ok with consuming less non-oil/gas/food things or sell assets to fund oil/gas/food things.