You can filter your tap water; there are various ways to do so. I’m sorry your water is contaminated. That’s awful.
I wouldn’t always assume the worst with the cows milk and butter. There is a wide range of product and conditions out there.
Certain kinds of plastics and applications are known to leach chemicals far worse than others. Frozen peas in plastic? It’s minimal. Food pouches for kids? Awful - it’s liquid that’s heated in the plastic to pasteurize it.
You can get olive oil in glass very easily. It’s usually the default. I order from the Napa valley olive oil company in bulk - glass jars with high quality oil that used to be excellent value. They’ve gone up in price but still decent value compared to the market.