I'd say your number is about right. Not just for bikes, but cars too. 5% of drivers follow me way too close, speed between lanes for no apparent benefit or emergency, pass far to close, don't signal, don't give time for people to adjust. 5% seems very low, but when there are hundreds or thousands of cars you see in a day, it's a lot of bad drivers.
And, I usually have a lot of steel and airbags around me to protect me.
It's the #1 reason I don't ride bikes on the road in the US. If I lived elsewhere I might change that.