I live by myself. There is nothing in my home that can/will distract me, aside from the internet--which I can just as easily use as a distraction from an office.
When I was at the office, it was not uncommon for someone to walk up and strike up a conversation that lasted 20 or 30 minutes and was completely unrelated to work.
And, on top of that, there's currently one single person I can think of of who a) I interact with regularly at work and b) works from the same office as me (if I were to go back to my employer's local office).
(Also, now that I think about it, I'm pretty sure that your entire "argument" is an Appeal To Tradition logical fallacy anyways)