Does this mean if I set up an alert for a server anyone can then add me to any number of alerts without further confirmation?
If that ever happens to you, you could: 1) pause the unwanted alerts, and remove some only when you need new ones. 2) if you panic, use the "unsubscribe" button that will block any future emails to your address.
Having such a low barrier of entry does not come without tradeoffs.