I think that the analogy is used because people underestimate how much heat is lost to radiation. Human body radiates energy away at about 800W. It's not noticeable, because normally it is balanced by a similar flux of thermal radiation coming in from the environment. If the apparent radiative temperature of the environment is reduced it can indeed feel like it is sucking heat out.