As long as they're discreet, they have my tentative permission to go about their business. But I will provide selection pressure towards discretion if I happen to be startled by their appearance.
Spiders are slightly higher class citizens, and more likely to be safely captured and released outdoors... but are ultimately subject to the same regime, at least between my walls.