> They are getting better at medium/large codebases
If we are strictly speaking about the cutting-edge models like OpenAI's o1, their context is getting smaller, not larger.
If we are strictly speaking about the cutting-edge models like OpenAI's o1, their context is getting smaller, not larger.
Even in a large code-base, you don't have to have the full context of every single file for every single question, can usually get away with half a dozen files, it's figuring out which ones to provide to the LLM to get the best response.