We are planning on adding 2-3 new languages soon (English, German, maybe Spanish), so if you would like us to fully open source everything - please support us here - https://opencollective.com/open_stt
A lot of feedback here, very nice!
As with the Russian Speech community for some reason people are willing to share their feedback on third-party forums, but do not bother to write to the author directly.
If you have something to say - please email me - aveysov@gmail.com or telegram me (@snakers4 or @snakers41) if you would a faster reply.
Also it seemed to me that some of the readers missed that there were actually 2 parts of the article - https://thegradient.pub/towards-an-imagenet-moment-for-speec....
With this all addressed, to answer some common criticisms / points raised below:
> Kaldi cool, NNs not cool
Though it is true that production solutions CAN be built with Kaldi (and I have even spoken with people who built them, as well as vosk author), we purposely omitted Kaldi because we believe that it is a technological dead-end. Also it depends a lot on antiquated technology, is very difficult for new-comers etc etc
Another problem is that ... it requires a lot of specific knowledge to add languages. Whereas our approach is just plug-and-play - just add more data!
For example - our best model in production is just 300-500 lines of code in PyTorch.
With so much resources poured in tools like PyTorch, it just makes sense to use tools that are simple / robust / offer a lot of future-proofing and cool features etc etc Also you can ofc switch DL frameworks if you wish =)
Also you can do CV, NLP, etc with PyTorch unlike Kaldi.
As someone noted, does not really matter what you are using, if it suits your compute. Fully e2e approaches still are GAFA scale only, and I just realized why Google even bothers with them - please see my post here https://t.me/snakers4/2445
> ML APIs changing w/o backwards compatibility
TF does that, and it is a joke. Paid marketing says that TF is cool, but real practicioners (that I know personally) use PyTorch. It is a holywar, but I believe TF just has a lot of captive audience ...
PyTorch core API on the other hand has been mostly stable since 0.4 (now it is on 1.4)! (!!!) No one speaks about this for some reason.
> Deep Speech is a bad starting point
Yes and no. Vanilla huge LSTMs are really GAFA scale only. But out networks is at least an order of magnitude faster. Please see this - https://thegradient.pub/towards-an-imagenet-moment-for-speec...
> cool open source datasets
Check out Open STT! We have not been able to OSS everything, because Russian corporations would use it w/o even crediting us. But you can support us and change it. Also other languages.
caito.de is really cool, albeit very small common voice - is very call, but on the smaller side libri-light - you have to align it yourself, so no difference really - easier to make it from scratch
Also I do not understand why people use flac, when opus exists?