Talking about a hobby as if you still do it, in order to get the job and provide for your family, is not a lie anyone sane would say matters. Next time, don't sweat it.
File it under Dale Carnegie's "How to win friends and influence people".
If there could ever be a treatise on psychopathy, that'd be it.
Although having said that, judging you so much on your "fit" is a pretty big red flag.
Everyone has hobbies just take the time to think about it and you will come up with something better than "none" which is not really exciting to hear and might send the wrong signal to the recruiter that you are not interested enough in the opening position.
The greater implication of my post, IMO, is that as I age I'm more experienced but less attractive to some employers solely based on my age. I already look about five years older than I am, so perhaps my career will be much more short-lived than I anticipate and I will have no say in it. That actually terrifies me.