Why design for vision, hearing, motor, cognitive impairments, older browsers, feature phones, 2g connections, motion sensitivity, unusual input devices, smart watches, tvs, game consoles, low-powered devices, languages other than English?
I don't mean to sound harsh, but I'm very tired of hearing this argument. It's not that hard to accomodate people, especially on Apple devices, they give you all the tools to do this.
Don't be shocked if X group is a small fraction of your users if your design has made it clear they're not welcome.