I think this is a good point, and is also likely why conservatives tend to prefer "minimal government" and "market forces."
As a society I think we need someone to keep us in check as individuals. Note: This doesn't mean totalitarianism, we can come to the same conclusions democratically.
This just means that socially we're more likely to vote for fair working conditions — but privately it's incredibly easy for us to be tempted into a choice that benefits us in the short-term and hurts someone else (or even ourselves) in the long-term.
I know I can buy more expensive meat from farms that treat animals ethically and supports local farms. When I look at my bank account as I'm grocery shopping on a Sunday... I'm not buying the more expensive meat. I'm capable of it, but I'm also financially risk-adverse.