Actually, in some sense, more people have servants, just that they are part-time: cleaning services, people who keep track of your schedule (executive assistants, but for normal people, can't remember the word).
When Microsoft Word automated away secretaries, it also raised the level of quality to be what was formerly available only at professional printers, so people spend the same amount of time, but now the expectation of quality of output is higher.
There can't really be widespread unemployment due to automation, because then labor costs would decrease and handmade goods would become more affordable, so people would start doing that.