Risk is a community exercise. You don't (or rather, shouldn't) get to externalize disproportionate risks upon the commons because it makes your life easier.
(An example of such a consideration: what happens when the fire department shows up? They know how to deal with a car accident; are they going to have the presence of mind not to douse a vehicle that looks like a normal personal aircraft in water?)
Why ordinary speeds? Someone driving into a building is likely to be going significantly faster, perhaps because they confused the brake pedal and accelerator.
Things like this happen all the time https://twitter.com/TempePolice/status/1529914550266368000
We currently have a billion cars on the road. Of course we have plenty of accidents.
But that's not a valid comparison.
And perhaps we should also get rid of carsnow your argument is totally invalid