I think LLM is ready for non-critical-path NPC chatter that you "overhear" in the game.

Putting it in the critical path will take a lot of development/testing.

https://github.com/opyate/godot-llm-experiment