They wouldn't if they only represented the number of people they were supposed to when the constitution was written (house members that is).
However we capped it at 435, so each congressman represents far more people than he is supposed to. I say technology has reached the point where we should remove the cap have thousands of representatives.