In an idealized situation though, why would the ball not stay at rest?
Only if the fourth derivative spontaneously changes from zero to nonzero. It doesn't seem any more surprising than the conditions f(0)=f'(0)=f''(0)=0 not uniquely determining f(x) for all x.
I'm not sure what the fourth derivative has to do with this argument.