The water sitting around in the pipes is likely colder, so it might be more than just psychological 'coldness'.

On the other hand, this brings my tap water closer to drinkability in the winter, so it's not all bad!