One opinionated answer to this question: LLMs can’t jump [1].

[1]: https://openreview.net/forum?id=klU4737opt