It's not about you following the rules. If someone else doesn't, your head is going to hit the ground.
I've only ever bashed my head on the ground at very low speeds. You'd be surprised the damage you can do falling from head height. A bike merely increases the probability of that happening.
High speed; forget it. I drive a car now after I was totalled by a taxi.