One of the ironies being that footballers can hit each other so hard _because_ of the padding and helmets. The better they make 'em the harder they'll hit and I suspect this is an arms race that will continue.
I've yet to be shown evidence that rugby players are suffering the same kinds of injuries NFL players are. Seems to be the same case with bare-knuckle or UFC fighting vs boxing.
The trouble is size. In order to spread out the impulse in time, the helmet must spread out the impact in space. There's really no way to do that by an order of magnitude without making the helmet much larger.