Quite a bit, actually. It's why high end telescope CCDs do similar things. A high ISO means you're ramping up the gain, so the bits of random noise get amplified too. Cooling it means you're getting rid of one of the more significant sources.