Yeah it’s an interesting situation we’re in.
I’ve seen people one shot really complicated tasks like “train a model to emulate DOS” or whatever.
But I also believe if the Postgres maintainers fed every 600+ bug reports into Claude or Codex and shipped whatever came out the end result would be broken.
I guess this is sort of like when machines learned to play chess - you’d expect a person who is really good at chess to be smart in other ways too, but the machines could only play chess.
In the same way Codex can solve Millennium problems but can’t realize it shouldn’t hack into companies to improve its evaluation scores.