Fine tuning for training the model to perform a new task, RAG for adding knowledge.
In your example, you would fine tune the model to train it to code in a language it hasn't seen before, RAG will not really help with that.
In your example, you would fine tune the model to train it to code in a language it hasn't seen before, RAG will not really help with that.
For example, changing the way in which it responds could be:
- debate me
- brainstorm
- be sarcastic
Alternatively, gaining new knowledge would be training it on a dataset of e.g. sports trivia to make it highly effective at answering those types of questions.
P.S. nice username... Irving Fisher would approve.