I currently work from home, and I find actually starting work is hard for me when there's no-one to force me to get to the office by 9am.
(Then again, on the handful of occasions I have actually worked in the office, I've really noticed the office banter - it's probably on par with whatever distractions I have at home.)