I don't disagree but context limits are expanding rapidly. Gemini 2.5 Pro which was used here has a 1 million token context window with 2 million coming soon. Cost will be a concern but context size limits will not.
Only issue is Gemini's context window (I've seen my experience corroborated here on HN a couple times) isn't consistent. Maybe if 900k tokens are all of unique information, then it will be useful to 1 million, but I find if my prompt has 150k tokens of context or 50k, after 200k in the total context window response coherence and focus goes out the window.