Can you give a concrete example of this problem that you expect an LLM to not be able to solve? It's fine saying "abstract concept" and "problem it has not encountered before at all" but these seem to me quite fuzzy concepts.
Maybe also what I wrote a bit above: describe some greater than 3 dimensional objects and get it to stack them for some purpose could be another thing to try (I think, I will actually).