One thing nobody talks about is that packaging technology back then was expensive.

4 bits fits into a 16 pin DIP well and cascades well. It is no coincidence that the 4004 operates on 4 bit units (BCD was also a factor). The 8008 needed an 18-pin DIP and was still far too constrained.

So, your choice of unit is likely a multiple of 4.