Even NYPD cops themselves can't do much about it: Here's one guy who tried to blow a whistle on his PD:
https://en.wikipedia.org/wiki/Adrian_Schoolcraft
The very people who were in charge of investigating police conduct reported him to his superiors. And then his own colleagues raided his house and forced him into involuntary confinement as an "emotionally disturbed person", handcuffs and all. The cops who delivered him to the psychiatric ward intentionally lied and misrepresented the whole thing to make sure that he remained confined and restrained.
Luckily, the guy had two recorders running during the raid, and the cops only found one, so there was ample evidence. I actually wonder if he'd still be in psych ward if not for that.