You are resting your pov on the assumption that more people = more and better jobs. This isn't necessarily true if there is an oversupply of workers to employers.