The majority of survey respondents seemingly disagree. Also, you argue a false dichotomy.
You shouldn't do that, of course. But one-on-one meetings are extremely useful in many lines of work, and are also a time when you're likely to be accosted. This whole article is about how a ridiculous fraction of people polled think co-ed one-on-one meetings aren't kosher.
Self-awareness and prudence are the answer, I think. Don't meet one-on-one with someone until you know them well enough. Well enough to judge their intent. Well enough to get a sense of their communication style.