The answer is simple: make random unregulated vehicles illegal. Actually, they are already illegal on roads, but only some cities do it for sidewalks.

If you say they are unsafe for roads, then make them illegal. If it's reckless drivers that are the problem, then that's the problem to solve; throwing more powered transport in pedestrian's way is only making it worse.