It’s really not that dangerous. If you’re a safe rider, riding in relatively safe environments, cycling is about as dangerous as jogging. And yet you never see anyone jogging with a helmet.
There was a recent video about this that summarized my thoughts on helmets