But isn't the innocent and natural bias toward sympathy with familiar subjects an ultimate cause of classism?
The upper-class homes of 1800s Britain had many working class servants. I have no doubt that in general there was some sympathy more for one's own servants over those of a neighbor's, and even more than for British landowners in Ireland.
That is, classism exists even in the presence of "the innocent and natural bias toward sympathy", because there's nothing in sympathy which demands the object of sympathy be treated as an equal.