It only takes one trip/slip/fall, one rock slide, one sprain, one break, one break, one deadfall, one snake, one asthma attack, one sting, or one rabid animal to turn an outdoor trip into a potential life or death situation.
99.99% of the times I've spend in the forest and desert has been "safe". It is the .01% and .001%s that get you.