Edit: yes, I was definitely making sure to use gpt-4o
Edit: yes, I was definitely making sure to use gpt-4o
I've found that GPT-4o is better than Sonnet 3.5 at writing in certain languages like rust, but maybe that's just because I'm better at prompting openai models.
Latest example I recently ran was a rust task that went 20 loops without getting a successful compile in sonnet 3.5, but compiled and was correct with gpt-4o on the second loop.
Also curious, I run into trouble when the output program is >8000 tokens on Sonnet. Did you ever find a way around that?
I break most tasks down into parts. Aider[1] is essential to my workflow and helps with this as well, and it's a fantastic tool to learn from. In fact, as of v0.52 I'm able to remove some of my custom code to run and test.
Started playing around with adding Nous[2] as well (aider is its code editing agent), but not enough that I'm using it practically yet.
[0] https://docs.anthropic.com/en/docs/about-claude/models