When people proudly proclaim that they simply do not care for the suffering of animals, I wonder if they realize that they sound like the millions of people who were on the wrong side of history.
The circle of moral consideration in the Western world started generally with land-owning white men, then (still generally speaking) widened to include white men without land, then women, non-white people, etc. The circle of moral consideration is slowly starting to cover non-human animals, though it will take hundreds of years before they are truly protected.
The folks who say they do not care about animals join the company of everyone who has historically opposed the widening of that circle, the people who stood against granting basic rights and basic consideration to those who enjoy them today.