Maybe set up an option to enable it if it's easy to implement? Because people make typos or you might want to make up addresses on the fly similarly to mailinator (but with corporate addresses).
The downside is that you will catch all spam too, and more importantly you will not bounce back the message to the sender informing them they've sent to the wrong address.