You can down-vote for whatever reason you like. You are trusted to justify it only to yourself.