I'm not trying to criticise you here at all, but since you don't eat meat mainly to reduce animal suffering, why are you okay with dairy? The dairy industry arguably abuses and mistreats animals far worse than the meat industry.
Full disclosure: Vegetarian for 10 years, eat fish occasionally and have recently been trying to cut out dairy (but it's tough).