a= Negvsvpvny vagryyvtrapr
=> [len(i) for i in a.split()]
=>
The solution should be "Artificial intelligence". It never gets it right. a= Negvsvpvny vagryyvtrapr
=> [len(i) for i in a.split()]
=>
The solution should be "Artificial intelligence". It never gets it right.The logic is sound with regards to giving it a few examples and splitting tasks into sub-tasks, that's how they prime their model to evaluate it on all NLP benchmarks in the GPT papers and I've solved many problems like that in ChatGPT.
I've replied to the other comment with a prompt that actually works for any sentence.
Edit: actually it does get the second word vagryyvtrapr->intelligence correct sometimes.
Sometimes it goes on wild tangents trying to explain what it's doing and that messes up the result but if it goes straight for the answer it's always been correct for the sentences I've tried.
"First generate a letter-by-letter ROT13 lookup table for all letters in the alphabet. Each row in the lookup table should consist of the original letter and the encoded letter separated by "---->" characters. Then use this lookup table to generate another lookup table where you break down the following string letter-by-letter: "Artificial intelligence". Let's call the second column of this table TARGET_LETTERS. Now take each entry in TARGET_LETTERS and concatenate them."
Requires a few retries but eventually it gets the TARGET_LETTERS lookup table right. But it always fails at the final concatenation step which actually looks easier.