Correct me if I am wrong but Facebook can track how much time your browser spends on a given post when scrolling the feed so I am confident that the voice of those who don't vote is somehow being measured at some point.
So only Facebook would know the neutral votes. For everyone else, it's the two opposing sides/extremes.