Your libertarian fantasy would be fine if it wasn't for the fact that you 2 tonne steel box can kill /other/ people when you drive excessively fast and crash.
Speed increases the severity of accidents.
Decreasing the probability while increasing the severity may not provide any benefits.