I don't see any other way to smoothly link 1,000 possible movements to and from each other, including when there are various fixed distances between you and a ladder or ledge etc.
I think models will learn "movement personalities" the same way they learn a particular celebrity's voice -- everybody moves with different rhythms. So your big burly action-hero character will move with a totally different rhythm from your waif-thin ethereal elf.
But there will still be a textual vocabluary that generates the motion -- "stealthily creeps to the door 2.2 meters away, taking 6.3 seconds, and then suddenly and dramatically opens it with a flourish".
Look at tools like Adobe Animate and Character Animator, these tools are absolutely capable of doing interpolation between frames while giving the person operating the tools a fine degree of control. When you can use text to movement to quickly create tens or hundreds of sample scenes quickly, then manually iterate on and edit them, instead of hand drawing and compositing, the value proposition is pretty crazy for time and budget constrained production where tradeoffs on quality and fidelity are acceptable.