Why would you want LLM navigation where offline deterministic navigation have been there forever?
The thesis is that someday an LLM might perform better than both. But I agree, not yet.
Navigation is a closed task, A* will always find an optimal route as long as your street info is current, you can't do better than that.