They'll know you visited the site before? Why would I want to lose functionality to mitigate against that?

Seems like a perfectly good thing to have as an app-wide setting tbh.