It’s amazing what throwing a ton of computers at problem gives you.
In the 80s-90s, Shannon’s predict the next token idea gave us spell check.
In 2000-2010 it gave us Siri & Google Home.
In 2020 it gave us ChatGPT.
In the 80s-90s, Shannon’s predict the next token idea gave us spell check.
In 2000-2010 it gave us Siri & Google Home.
In 2020 it gave us ChatGPT.
I remember a presentation by Bill Gates, about the cutting edge statistical modelling based translation and speech recognition at Microsoft, similar to what Google was doing. The software was live-transcribing him, well enough that he could be understood. I was floored. Assuming this wasn't tailored to Bill specifically for the demo, it was revolutionary technology of the kind I had expected to take much longer to develop. That was 2008. At the time the notion that speech might become a common interface still seemed rather far-fetched to many. By 2018 such tech was everywhere. Deep learning based models have now closed much of the remaining gap in just the last couple years.