Why is "without prompting" a requirement? If a hypothetical LLM comes up with the best neologisms that one can imagine, but only after prompting, then they're disqualified?
Either way, my issue there is actually with the fact that the LLM can only predict what a human might say in response to the prompt andz as far as we know, don't have any way of logically thinking through the new solution or modelling reality to understand if the idea might actually work.