Why shouldn't our neighbors use their powers as voters to keep their peaceful suburban street from being used as housing for migrants, minorities and other undesirables? I'd bet that'll affect housing desirability far more than short term rentals.
Why shouldn't they use their power as voters to ban the construction of affordable homes in their vicinity?
Why shouldn't we use our power as voters to proscribe alcohol in their town? What could go wrong?
Your power as a voter isn't supposed to be the power to arbitrary meddle in other people's business.
Are you okay with a meat packing plant in your neighborhood?
As a consumer, it has to be good enough if there are only some areas where it's allowed, and some where it's not. Or maybe allowed but only up to a certain density or percentage.
Anywhere it would be allowed without limit I would probably not want anyway, just like a hotel. Most airbnbs are run like little hotels now anyway and I hate most of those, but at least there is variety and plenty are good still.