I think the problem is that people don't really understand nonlinearities in these things.
Imagine somebody aims a gun at you and I say, "Watch out, he's going to shoot you!" Then he fires the gun, but it misses you by an inch. You wouldn't say "you idiot, the bullet didn't hit me at all." But the weather equivalent has people thinking forecasters are stupid.