249 karma · joined March 28, 2019
Shows an EXTREME lack of creativity when ANY solution is to basically shut down the website.
Perfect way to get people to seriously start looking for alternatives.
Elon being ableist in his last reply, telling people to touch grass if they get rate limited.
He's got access to a lot more than us. This isn't just some congressman indulging it for the lulz. It's so funny to see the mental gymnastics people here make to discredit some of our most elite intelligence officials. Even Rubio is having trouble believing it but he's now admitting to have talked to people with direct access to the program. Grusch is as credible as it gets. He said he spent four years investigating this before he came to the conclusions that these secretive exotic craft programs exist.
Google has an ingenious approach whereby they debuted with a bad model, and are secretly improving it. OpenAI did the opposite, they released a model that blew everyone's minds and are now making it worse.
We should get access to the original models. If the TikZ deteriorated this much, it's a guarantee that everything else about the model also deteriorated.
It's practically false marketing that Microsoft puts out the Sparks of AGI paper about GPT-4, but by the time the public gets to use it, it's GPT-3.51 but significantly slower.
They seem to be virtue signaling about their lack of progress now. Months later, GPT-4 still slow, still not multi-modal as they advertised, still significantly limited, you need to sign up for a waitlist for almost every feature, no sense of privacy, no understanding of their plan for improvements. Google is full steam ahead and consistently improving their free LLMs.
They actually had a genius strategy. Put out Bard with a very stupid LLM, so people aren't blown away and it doesn't get the doomsayers on their case. Now they can continue to quietly upgrade Bard. Eventually it will be so obvious that they have surpassed OpenAI.
OpenAI must enjoy watching their unsubscriber count go down. After all, Sam did say at the congressional hearing multiple times "We would prefer if people used it less".
For someone that's interested in crawling all the URLs (by avoiding the 10k limit) that were backed up, I found you can add YYYYMMDD in the * of the URL to see the sites archived during a particular year, month, day etc...
https://web.archive.org/web/2022*/txti.es/*
https://web.archive.org/web/2023*/txti.es/*
I think one solution would be a word processor that records the process of writing a paper and you need to turn in your paper along with your recording. Of course this is going to create added stress but what else do we do? There's going to be GPT scramblers that remove watermarks.
[1] https://www.businessinsider.com/professor-fails-students-aft...
People like Ben Goertzel believe that GOFAI / Symbolic AI is going to be revived from the AI Winter era like how deep learning was. Here's a recent quote from his Twitter: "LLMs are very powerful and will almost surely be part of the first system to achieve HLAGI. I suspect more like 20% than 80% though...."
A model that got to the point where it's possible for it to propose new architectures, improve optimization & efficiency.
In other words, the extremely massive model that could do this doesn't need to be available to the public. It's sole purpose should be to be used internally by a company to improve itself.
This is actually the point at which many say could lead to the singularity.
There's a ton of potential left on the table. The question is if transformers have hit their limit with GPT-4 or not.
It's a pretty simple equation when you think about it this way and why Sam would say they have hit their limit. Sam is basically Microsoft and they want to retain their lead. Once Google learns to put their data to use correctly, it's almost guaranteed game over for OpenAI if they want it to be.