Maybe it's a good way for YC/HN to find out which things don't work, in a short span of time.
If you want >90% of projects you invest in, you need to invest in conservative fields, and grab 30-70% very early on, because your returns will be way lower.
As for not bringing anything to society - you mean to say that tech field and our startups didn't bring worth to society? Seriously?
Wanna talk about surveillance capitalism? Ultra consumerism? The biggest startups in the world have created a world where the goal is to win people's attention to sell ads. The goal of startups today is not to make good and useful products, but to sell stuff. Usually it means that time to market is more important than quality. Remember fitbit? "Doesn't matter if the product is crap, as long as it is cheap".
Not everything is bad, but I think we can definitely wonder if the world wouldn't have been better off without those startups.
I'm not saying it's going to happen, and I hope it doesn't, but when I did a little analysis for an idea I have it was absolutely the biggest threat I could see. OpenAI has the ultimate vendor lock-in - there literally isn't an alternative right now.
(This is a giant opportunity if you're a billionaire investor. Providing an AI backend is probably the next cloud infrastructure. OpenAI is going to be the AWS of that industry, but there's room for an Azure or a GCP too.)
Yes, keep it in the back of your mind and design your systems in such way that when the time comes replacing the GPT doesn't require rewriting your entire codebase.
Your immediate #1 priority in such competitive market should be to execute your idea and get paying customers, then you deal with breaking off OpenAI.
You can train GPT2 in a couple weeks on a dozen GPUs. Sure, it’s a lot worse than GPT4, but not insanely behind and the community is fast.
Same for RLHF. It is for sure fine engineering, but not unreachable for a motivated and competent bunch.