> As long as we have questions to ask, they are not theoretically constrained
> some infinities are bigger than others
Those are both limitations. They need conjectures and they need training data. Can they produce their own conjectures and training data, and feed off it forever, while staying meaningful and not being stuck in a loop (a very large set of repeating cliches) or descending into confused noise?