It seems like LLMs are becoming a commodity. This just wrote me some code that at first glance is as good as what I get from GPT4.
OpenAI better have some earth shattering thing up its sleeve because I don't understand what their moat is.
OpenAI better have some earth shattering thing up its sleeve because I don't understand what their moat is.
Their initial moat was built with ChatGPT, which was launched less than a year ago and was surpassed by competitors in less than 6 months. Their current GPT4 is less than 6 months old. While your statement may be true for now, I don’t expect it will hold longer term. They have name recognition advantage, but so did AOL.
Agree with both and I work in information extraction too.
Most likely parsing unstructured data (a superset of NER).
It looks like GPT4 has approached an asymptote in quality (at least within a compute time window where they remain even marginally cost effective). Others are just catching up to that goalpost.
Even GPT4 suffers from the same problems intrinsic to all LLMs-- in real world use, hallucinations become a problem, they have a very difficult time with temporal relevance (i.e identifying when something is out of date), and they are horrifically bad at any kind of qualitative judgement.
Politicians know the later is real, and they also know that the "Terminator" fear is unfounded, at least for now. At least in the US, I doubt very much Congress will cater to OpenAI. They know it's going to undermine the prospects of the entire AI industry in the US and its long term competitivity in the international arena.
The US military will not be using lobotomized AI.
When the inevitable regulation starts rolling out, OpenAI expects their lobotomized models to outperform competing lobotomized models, because they'll have a huge head start (and probably will have had a hand in guiding the legislation as well).
I've seen too many first movers fail to differentiate themselves and eventually fall behind their competition to really believe that resources and talent alone constitute a viable moat.
Some would argue they can even be a hindrance, if they render the company complacent and risk-averse.