That's a straw man. Helmet advocates do not imagine them as some sort of invincible armor. They obviously will not keep you from being injured in a serious accident. What they do is reduce your chance of being killed. The large majority of fatal bicycle accidents involve head injuries. (One source: http://www.rospa.com/road-safety/advice/pedal-cyclists/facts...) I would rather be in traction than dead.
I agree that children cannot be wrapped in cotton wool; they should be allowed to roam without supervision and make their own mistakes, even if that does slightly increase their risk of injury or death. But getting a bike helmet for your kid does not restrict their mobility or their ability to learn. It has no downsides, only upsides.
You've made the choice not to wear a helmet; if you ride safely, in a safe area, the extra risk is probably quite small, and if you believe it's a fair trade-off for a little extra comfort, that's your prerogative as an adult. But don't pretend that wanting to feel the wind in your hair is taking a moral stand.