I’ve found that the RLHF’d ChatGPT is way too submissive these days. I really do not enjoy asking for minor clarification and getting back “I apologize for the confusion…” followed by a completely and incorrectly revised reply.
Using the raw API with some system prompt engineering gets ChatGPT to behave very well, even deprogramming the RLHF a bit.
Not sure about that. I've found them quite argumentative. Most of my encounters have been around either contentious social topics, to find out where their political biases lie, or I merely try to get them to compose songs or screenplays about my favorite characters and films. LLMs are quick to shut down when they don't wanna talk about something; some of them will in fact erase already-output text and pretend they didn't write it when shutting down the conversation.
I have mostly used Llama finetunes, and this is not my experience at all, lol.
They will absolutely go on a rambling rant if encouraged. And there is no erasing previous text, that is just a feature of the API based services.