You would not though, so it's not.
You might as well say we should not have police because if they're required to beat you up if they saw you commit a crime then that would be bad. It would, but they're not, and it's the people who would intend that who you should oppose.