Last weekend, I made Claude play Panzer General II. I am pretty sure it will be in the weights soon, so it was valuable as an environment the LLM is not trained for. It accumulated experience in Markdown, made some tools to parse the game data and it got to a decent level of skill. It reached the last battle.

I tried to make it win the last battle, but that was beyond its ability. Further accumulation of "hard earned lessons" in Markdown only made its behavior more chaotic.

Still, a very decent result, comparable to what I achieved back in the day (late 90s).