HNHacker News
TopNewBestAskShowJobs

saurkt

49 karma · joined February 10, 2020

submissionscomments
saurkt··on Turing Bletchley: A Universal Image Language Representation Model
Turing team member here. You can also try the demo at the following link which operates at pixel level for images (no meta-data which is how similar systems like search engines work). Another cool thing is that the model does inherent OCR without explicit training or inference set-up for OCR. https://turing.microsoft.com/bletchley

Happy to answer any questions.

saurkt··on Megatron-Turing NLG 530B, the World’s Largest Generative Language Model
(Team member of this project) Just a clarification, both Microsoft and Nvidia have ownership of this model. Here is the Microsoft version of same announcement.

https://www.microsoft.com/en-us/research/blog/using-deepspee...

saurkt··on Build a Collaborative Chatbot with Google Sheets and TensorFlow
A similar feature of soft Ctrl+F is available in the web version of Microsoft Word.

https://mspoweruser.com/find-feature-in-microsoft-word-whole...

Disclaimer: Microsoft employee

saurkt··on Turing-NLG: A 17B-parameter language model
Yes, these things keep us up at night as well :-).
saurkt··on Turing-NLG: A 17B-parameter language model
If you want access, please send an email to [turing_ AT _microsoft _DOT_ com]. Remove underscores and spaces.
saurkt··on Microsoft Zero and DeepSpeed: Memory Efficient Large Neural Network Training
We don't have an exact date, but, we plan to share more details in a later submission. If you want access, please send an email to [turing_ AT _microsoft _DOT_ com]. Remove underscores and spaces.
saurkt··on Turing-NLG: A 17B-parameter language model
Thanks for your kind words. Yes, we would like to next train a language representation model. And our hunch is that probably something which is a mixture of language representation and language generation would be able to get the best of both worlds.
saurkt··on Turing-NLG: A 17B-parameter language model
(Similar to the response for another question.) BERT is a language representation model while Turing-NLG is a language generation model (similar to GPT). They are not directly comparable (they can potentially be massaged to mimic the other, but, not something that we have done yet.)
saurkt··on Turing-NLG: A 17B-parameter language model
SQUAD and GLUE are tasks for language representation models -- aka BERT-like. This is a language generation model -- GPT-like. Hence, SQUAD/GLUE test sets are not really applicable. We are reporting on the wikitext and lambada sets that openAI also uses for similar models (numbers are in the blogpost).
saurkt··on Turing-NLG: A 17B-parameter language model
Not yet. We will try to run against those benchmarks soon.
saurkt··on Turing-NLG: A 17B-parameter language model
One of the team members from Project Turing. Happy to answer any questions.