actually Matt mentions the same problems as Scott Aronson. If an LLM works on a codebase with lots of tiny modules, or a code base that has ten data layers added by previous runs, then poor LLM will make bad decisions.

Now what happens to mathematics, if prior art gets filled up with spaghetti code like proofs that no one can verify? Maybe there is some hallucination somewhere in the middle that has been left unchallenged by the other agents? Nobody can tell.