It's not an LLM. It's just Finite State Machines, Behavior Trees, Utility AI and Goal Oriented Action Planning.

This should cover all you need to make an NPC a bit smarter (but it is still "scripted").

LLMs are not what you would use to make a bot in Civilization, or Age of Empires.