If I had a dollar for every person I've seen randomly browsing Facebook or similar at the office, I wouldn't need to work anymore.
Now I understand that not all people are the same towards work and motivation, and I particularly sympathize with the spouse thing. So I think the broader issue here is management attempting to impose a single One True Way for everybody, which doesn't seem to exist.
I also think that the spouse thing may be somewhat a question of habit. As in, after a while, the spouse may end up appreciating that your being at home doesn't mean you're free to do whatever. But you're still able to go start laundry when taking a five-minute break, which is still extremely valuable and couldn't be done from the office.