Midsummer is amazing (and you can swim in the harbour).
Unfortunately Dec/Jan are pretty grim. It's cool -- once -- to use your subway fare to take a tiny ferry that breaks through the crust of ice. But not seeing the sun, except for a dim, watery glimmer around lunch time, is not nice at all.