People did starve to death and turn to things such as alcohol due to labour displacement during Industrialization. At the time, the prevailing wisdom was that lower-class people were naturally inferior. Robert Owen challenged this theory.
And yes, that was the choice given to the Luddites. Have no work (and therefore no food), because the factory owner can replace you with machines, and you have no labour rights, so he will simply cast you out and make more profit. I did not miss Mr2Z's argument, yours is just incorrect.