HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by cranberryturkey | Hacker News Reader
Parent
Full thread
cranberryturkey
·
Isn’t there a limit to the size of the prompt?
View on HN
Jimmc414
·
Yes, that’s one of the advantages of RAG as it helps you dynamically feed text into the model based on semantic similarity to the question as opposed to sending all text into the context window.
Reply on news.ycombinator.com