It is simply because class divide used to be a lot wider. We perceive things as going down only by comparison with unhealthily equal 1960s society brought about by 91% top marginal tax rate of the day. Pre-WWI world was extremely unequal and it was seen as normal. Anyone from the middle class could hire a servant.
In fact, even in the Soviet Union, engineers and even highly qualified workers (!) had full-time domestic servants in 1930s. Not after the war though.