They've improved, but not consistently on human timescales.
Being a worker in the pre-labor-movement industrial revolution was by all accounts horrendous. Things have, so far, trended better over time but they can be bad for whole generations and also past results do not guarantee future results.
> The cases where it didn't were generally offset by the rest of society benefiting from increased automation and productivity.
I don't think we can sweep the worst parts of it under the rug because the bad impacts are only happening to "the poors". And anyway when it comes to the current tech revolution, it is likely that almost all of us are going to be "the poors".