Your explanation is a nice restatement or interpretation for what the equation f(x)=f(0)+f'(0)x+.... is saying, but it doesn't give any insight for why the equation is true.
and as there is no additional change that comes "out of nowhere", so to speak,
The whole explanation rests on this key point, and in fact this is the unintuitive part. In fact, it's not even always true. It's a "miracle" that it sometimes is true.