This is very size and speed dependent, but increased viscosity delays separation and can actually reduce drag [1], [2]. In any case, the viscosity difference is not huge and water temperature is normally not precisely controlled for swimming events.
"Most people [...] suffer from vasodilation in extreme cold."
Only when the core is doing well [3], the opposite (vasoconstriction) occurs otherwise.
[1] http://jeb.biologists.org/cgi/content/abstract/204/1/81
[2] http://www3.interscience.wiley.com/journal/120798746/abstrac...