Lots of people on the other side of the hills (Concord, Moraga, Walnut Creek) have this idea that Oakland is a really scary place. I think it's partly racial (because of the higher percentage of African Americans here) and partly a PR issue (the 24/7 news cycle only presents sensational items).
I've lived in the area since 2001. I lived in Berkeley for the 13 years prior. I had more problems with crime there, and I was fairly close to campus. People don't normally think of Berkeley as a high crime place, either.
The most dangerous thing I deal with on a daily basis? Cars and bikes. I always cross the street legally, but both cars and bicycles have issues when it comes to respecting pedestrians. I've even seen a police car not yield for a pregnant woman pushing a stroller in a cross walk! He cruised by her within inches. I was dumbfounded. She was in the middle of a 4 lane (2 each way) road.