Because LLMs can't do math and don't understand 3D.

If they want to do either, the LLM needs to write programming scripts which takes far too long for every millisecond of movement.