If you use it as a generic downvote button, your flag privileges may be silently removed.