Luckily work just gave me access to ChatGPT Enterprise and O1 Pro absolutely smoked a really hard problem I had at work yesterday, that would have taken me hours or maybe days of research and trawling through documentation to figure out without it explaining it to me.
It’s a well documented Microsoft process but I didn’t even know where to begin as it’s something I hadn’t used before. I gave it the authorization policy (which was AND logic, and was async so it’d reject it any of them failed) said “how can I have this support lots of attributes” and it just straight up wrote the authorization filter for me. Ran a few tests and it worked.
I know this is basic stuff to some people but boy it made life easier.
I tried DeepSeek, it's fine, had some downtime, whatever, I'll just stick with 4o. Claude is also fine, not noticeably better to the point where I care to switch. OAI has my chat history which is worth something I suppose - maybe a week of effort of re-doing prompts and chats on certain projects.
That being said, my barrier to switching isn't that high, if they ever stop being close-to-tied for first, or decide to raise their prices, I'll gladly cancel.
I like their API as well as a developer, but it seems like other competitors are mostly copying that too, so again not a huge reason to stick with em.
But hey, inertia and keeping pace with the competition, is enough to keep me as a happy customer for now.
You can also use tools like litellm and openrouter to abstract away choice of API
Also they just updated 4o recently, it's even better now. o3-mini-high is solid as well, I try it when 4o fails.
One issue I have with most models is that when they're re-writing my long scripts, they tend to forget to keep a few lines or variables here or there. Makes for some really frustrating debugging. o1 has actually been pretty decent here so far. I'm definitely a bit of a power user, I really try to push the models to do as much as possible regarding long software contexts.