I don't think there are problems unsolvable in principle. Given a good enough specialist and some amount of time, it's possible to guide an LLM to the solution eventually.

The problem is that people often can't recognize whether they are getting closer to the solution or not, so iteration breaks.