An AGI needs to be able to take an abstract concept and apply it to create a solution to a problem it has not encountered before at all - not sure LLMs can do that really. The lack of mathematics might be quite limiting there.
Maybe also what I wrote a bit above: describe some greater than 3 dimensional objects and get it to stack them for some purpose could be another thing to try (I think, I will actually).