Yup. Feature. Allows you to do all sorts of fun things...like signing up for many twitter accounts on one gmail address.
So, I'll use the plus to sign up for something that may produce junk (to differentiate it), and then attempt to unsubscribe--producing an error as the web form email validation to unsubscribe doesn't accept the plus. Doh!