Austerity is not the same a misery. In some ways I live an austere life but I am happy. Misery comes from poverty not self imposed austerity; the first is often imposed by the outside world whereas your father's and my austerity are, as you say, self imposed and under our own control.