I think it comes from the general belief that poverty is bad and a simplistic view of cause and effect. "Before the Empire they were really poor, with high mortality, after the empire they were much wealthier with lower mortality".

It's just going to be the default view if one does not have further information.