If I need new hardware pieces, its either next day shipping, a few days by air-freight or three weeks on a boat from china.
This limits prototype turnover time, and means iterating quick is much harder.
Finally you have the problem that hardware is expensive and an additional cost. A hardware startup has all the same costs as a software company but with the addition of hardware.