You're right! Incidentally, he died of skin cancer (this is not a joke, please cover up, wear sunscreen, get checked by a doctor).
I will offer somewhat opposite. My father had 4 kids and at my age looks roughly the same. That is look like we where/are in our late 20's at age 40. Genetics goes a long way.
Are you both rich? Being poor can really help assist in looking old. Stress is a killer and being poor is nothing but stressful.