HDPE is also what Nalgenes and the like are made of (or used to be anyway), and is very popular for storing chemicals as well. It is very nearly completely inert.
all the polyethylenes are relatively inert, because polyethylenes are in some sense just heavy paraffins. paraffin is germanized latin for 'relatively inert'
Some Nalgene's are polycarbonate, like those commonly drunk from. But not all, some are HDPE[0,1,2].
Some are Polypropylene co-polymer[3] but those are more for specialist things I guess.
[0] https://ultralightoutdoorgear.co.uk/ultralite-1-litre-wide-m... [1] https://www.cotswoldoutdoor.com/p/nalgene-hdpe-125ml-wide-mo... [2] https://www.elitemountainsupplies.co.uk/camping-trekking-c4/... [3] https://www.thelabwarehouse.com/products/bottle-nalgene-ppco...