> Having worked in the space on-and-off since my PhD, the pace is not "overwhelming". You just started paying attention to it.
>ChatGPT and Stable Diffusion are good, but they're incremental gains over what came before, which were incremental gains over what came before that
>The AlphaFold example is apt: yes, it outperformed methods at CASP. It was indeed a dramatic leap
>Are these large transformers a dramatic improvement? Absolutely. No question.
>Has this been an evolutionary change over the last decade or so? Not a smooth curve, but yes. The world didn't suddenly change overnight.
Starting with AlexNet there have been numerous discontinuous improvements in CV, NLP, Game Playing, etc. It's just not true to say otherwise.