I had a similar experience in a previous role (minus the lack of recovery), and I second this: there is a mental/emotional cost to "getting paid to do nothing". I suspect it's similar to why some people feel driven to work even when they've become "financially independent".
If you don't mind sharing, what did you do after that job?