I/O pads (and their drivers) take up a huge amount of space. For some simpler ICs their die size is determined by their Pads.