That's completely fair. However that's a corner case for most people. I think the general use case is that people have routines in their day to day and fit these devices into their predictable routines.
Adapters suck for unpredictable situations but those aren't common enough and Apple knows this.