Depends what you enjoy. Some people would rather work than relax. I've had colleagues that hang about at work for a little longer to avoid the drudgery of home life - or rather the hand over to the next shift.

That said - I do agree with you that a lot of these people are neurotic. Not all work is equal - some of it in my opinion is a waste of time - and it just keeps people off the streets.