And that leaves you with how to dump the heat out of the water, and that is most effectively done (in a small scale) with thermo-electric coolers. You can add scale cooling very effectively by turning on additional coolers. My design is pretty simple, the reservoir tank is on top of the rack and there is a heat exchanger on the bottom and one in "front" of the CPUs. As they draw air through the heat exchangers the water warms and rises to the top where the reservoir is, and the chilling water in the reservoir naturally sinks back down to the bottom where the first heat exchanger is.
You can think of it like a rack sized version of the liquid cooler you can put on an enthusiast PC these days. Its quiet, self contained, and quite efficient, while still being able to use forced air cooled server equipment. The goal being efficient cooling in a temperate climate (California Bay Area) that is quiet and can use surplus/old equipment that was originally slated for a data center without violating any of that equipment's assumptions about the environment it can count on.