This is the RL training. Like, I'm not even sure how one could train for better design.
Certainly, it would be super super difficult to generate training data for it, so it's unlikely that it will improve.
Certainly, it would be super super difficult to generate training data for it, so it's unlikely that it will improve.
Because of the scale that would be needed. Like, design stuff is much fluffier than code correctness or functionality, so really really hard to generate enough synthetic data to tune the models to do better.
In the limit yeah it would work, but in the limit we're all dead ;)