Honest question: how to prevent abusing this system?
But seriously: there isn't a way. This is why sites like Glassdoor are garbage and teacher rating sites have ruined careers over minor issues.
That means one person can't run a smear campaign. At least 2 or 3 other people have to agree with you, and if they do then it's legit. The system masks the persons negative reviews until that manager has accumulated greater than 3 or 4.
Three or four negative reviews from people in the company is NOT a minor issue.