What you see as abuse some would see as user agency. User agency is a very powerful thing, and it's shortsighted to squash it just because your users aren't using it strictly to enhance your content in the way you want.
It's especially shortsighted to squash it just because they used it on some of your advertisers' content and your advertisers yelled at you about it.