More physicists mean more competition, more physicists mean more people to convince that a radical idea is worth pursuing, and even more so more people to convince that a radical result is true.
If the field was smaller and those in it had more freedom, we might see more interest in exploring new areas. Right now it’s hard to see many people in the field with enough freedom to do anything that isn’t the prevailing orthodox view.