I have fond memories of a remote job where the team met in person every quarter. We shipped software on a quarterly cycle; we'd meet up each time, to celebrate the latest release, and spend a week planning out the next one.

Even as someone that's vehemently against office working, I agree with this. Close contact with the team a few times a year just to get together for a couple of days of food and drink is great for team building. Any more than that and I'd go nuts.