Most of the older people I know that are "working hard" are running businesses, no 40 hour weeks there. Also Me and my friends are not wealthy but we work and study constantly. Also lots in my family work in the mines which are long 12 hours days many in a row (my Dad has it easier, only 10 days in a row of 12 hour days). I know very few people working 40 hour weeks.

Working doesn't necessarily stop at the end of the typical working week or even 40 hours in that case. Working hard can include renovating your own house, toiling in your own garden, cooking, cleaning, volunteering, networking, all sorts of things.