There are definitely times when it's tough. A tight deadline is coming up at work and Friday's sundown is just hours away. But I plan around those things and I find that on the whole, having a day (completely) off of work relaxes me a ton.
These days, technology is literally built to be addictive. I'm sure there are people who resist checking their phones, writing emails at 2am and reading hacker news better than I do, but I think the majority of people would benefit from an occasional day away from these things.