is it physically possible to have non-continuous acceleration?
At macroscopic scales, I’m not aware of exactly instantaneous acceleration, since you would need some time to “sync” the movement of each atom in the object. But some processes will of course look instantaneous at any given time scale.
Figure 4-3 in https://www.ibiblio.org/apollo/Documents/lvfea-AS506-Apollo1... shows this for Apollo 11.
There is an interesting Δa/Δt while fuel is consumed and mass changes.
There are discontinuities to the graph when engines are shut down and stages decoupled.
Over a macro scale, it’s discontinuous, of course.
But, checkout Zeno's paradox for more on your philosophical questions