It's infeasible without spending a lot of time studying the tiny print on the packaging of almost every item you buy apart from produce, meat, bread, and dairy. And even then some people will end up having to rigorously change their shopping pattern. This is in addition to all the other environmental and ethical issues in the supermarket: animal welfare guarantees, chocolate that doesn't screw the farmers over, sustainable fishing, local produce, and of course choosing to shop with the goal of eating healthy in that hall of temptations.
This is not something consumers can fix buy voting with their wallets. It's just too abstract: palm oil is used in so many products that have no strong link to that issue (unlike meat and seafood).