> Usually, if I don't get the answer I'm looking for from ChatGPT, I tell it it's not the answer I'm looking for, what the original answer was missing, and I usually get a better answer the second time around.

This is an expected behavior, as by default even with RLHF ChatGPT will output statistically "average" content. It's also the reason why Chain of Thoughts prompting works very effectively.

I have a (somewhat out of date) notebook demonstrating this, plus a function calling trick which allows you to get the improved result in a single API call: https://github.com/minimaxir/simpleaichat/blob/main/examples...