Thousands/millions out of work may (or may not) experience morbid effects. They will have a harder time participating in the buy side of the economy and driving demand, and also represent missing productivity. That's nothing to sneeze at.
But thousands/millions dead are guaranteed morbid effects. And dead people are even harder to get back into the demand side of the economy (or productivity) than jobless people.
Also near the peak of an unconstrained pandemic... what should we think people's improvised reactions will look like? Business as usual, no economic impact?
The best way to not have an economic impact was not to have an uncontained epidemic we weren't prepared for. We kinda missed that step. Why would we have a choice not to have serious economic impacts at this point?