I noticed that LLM at least at the Claude and OpenAI 4o level can not play tic tac toe and win against a competent opponent. They make illogical moves.
Interestingly, they can write a piece of code to solve Tic Tac Toe perfectly without breaking a sweat.