The yearly average global temperature is moving slowly (but at increasing speed. we are increasing emissions, old emissions accumulate for centuries, and we are already triggering positive feedback loops).
Extreme weather is not, both in severity and in frequency. Doing big averages from a far, safe distance hide you the fact that is not so safe at local level, and the increase frequency turns every place into a dangerous to be one eventually.
Sea rises slowly in average, but still there was plenty of floods this very year. You don't have to wait till the ocean catches you, an atmospheric river could ruin your life too.