For sure, it's only worth doing if you actually have so much relevant data that it doesn't fit in the context! This is definitely the case for us for this problem, but it's not universal.
But the majority of talk about RAG is coming from hype driven individuals that produce low merit and uninformed opinions.