Honestly, it wouldn't make a difference.
Some VCs are sleazy, but their money's still green. I know with certainty of at least two firms with predatory/creepy partners, but that wouldn't stop me from including them in a round.
This behaviour is inappropriate, but it's not nearly as bad as what we learn to fend off at the average final club/frat party.