Am I describing an LLM or a programming language?
Templates have been a thing for a long time and beyond being better than Google at finding them LLMs fall into the exact same problems those did:
If they don't exactly fit your goals you end up wasting a ton of timing fixing the edge cases.
i've often been able to get them to write working code to harness libraries i just wrote (so they definitely aren't in their training set) or programming languages that i haven't even implemented yet. i've fed them obfuscated code in one programming language and asked them to translate it into another—getting sometimes very buggy output, sometimes not. i've asked them for problem-solving approaches for novel problems and gotten reasonable answers—sometimes