As an American pedestrian I find cyclists far worse on average than drivers. They far more often ignore traffic signs and I have seen multiple collisions including one that looked quite serious, though luckily no fatalities.
On a per person basis my personal annoyance scale goes subway riders have least impact, followed by busses, normal pedestrians, cars, joggers, then cyclists at the top. Obviously cars are quite dangerous but they are more predictable. Bikes and joggers seem to spend a lot of time looking at traffic not who they are going to run into.
Edit: To be clear I think this would improve as more average people start cycling.