Could there be more ChatGPT moments down the line in other areas like science, genetics, space and something we haven’t considered? I think there’s a chance.
I also think AI is here to stay and there may be some confirmation bias from the community regarding open source models. It’s like someone saying back then that Linux was going to take over… (?) Open source software seems to be served for technical people. Not for the average Joe looking for an answer or help generating a social media post or help writing an email.
I'm thinking here of LLMs as a lossy compression of all our published knowledge. And then agents doing some smart/heuristic search relative to that. They can surely find things that we have missed -- just because they'll tireless try all avenues of investigation that humans might have given up on -- but if the underlying data is not there they can't manufacture it.
LeCun has made this point elsewhere wrt world models and more ordinary physics. This issue is exaggerated in the case of biophysics and quantum mechanics.