It’s hard to imagine a way embedding or RAG could help you with “take response 5 and 8, combine them and distill into a summary, but with a more emphatic style”
Because e.g. if you need it to answer in a very specific way, it might be helpful for the ChatBot to see what the other potential ways are so it would know to contrast even more.
Yes, it's influencing the output of the model, but it's unclear to me without extensive trying in which way, because it could be positive influence as well.
As for efficiency. It doesn't add that much in terms of magnitude if you already have long conversations going on.
Finally. Using external libraries and building out the things that you are mentioning will take time, trial and error. Just modifying the initial prompt is easy, and you can start to use it immediately.
So the main positive is just that it's likely faster and easier to implement compared to building out those systems.
And I would note the instructions to manipulate the context are an important part of the context and output. This is just a highly concise and unambiguous way that primarily exists outside the latent semantic space, so I would expect attention would be high given the way it’s composed. I would have used more unique tokens to even more draw out the instruction language.