In 1820 if you said that 99% of farm labor will be replaced by machines in 100 years, you'd have been given the response of 'bullshit'. And yet a century later we had done just that.
With that redistribution of labor came the largest wars the world had ever seen. We don't even have to eliminate 'whole classes of work' to destabilize the working world and economy. Just eliminating 25% of work and not coming up with something new for the now jobless to do will create a wave of populism that can cause problems.