the benefits of the business goes to the private person running the business from their residence.
But the externalities falls to the community (or at least, shared by the community).
Therefore, a community wanting to ban a business from a residence is very valid imho.
However, if the business could either prove there are no externalities, or compensate for it in some way, then there should be room for negotiation, rather than a straight outright ban.