An Introduction to Deep Learning for Language Modeling
ofir.io
ofir.io
honestly i would just watch both, and start with cs224d, but if I would have to pick one, it would be Oxford's.
My boss asked me to take CS231n about Deep Learning, and I decided to put some of my Chinese data into the same tools (Word2Vec) to see how it performed.
Honestly, it sucked. Was that my bad coding (very possible). Or is it because the examples are cherry-picked to work well with English? Can someone recommend a tutorial of Deep Learning for languages that are not English?
Most of big advances in the past five years have been around Natural Language 'Parsing' of unstructured information into structured information (this is what Deep Learning is very good at, so far at least); classifying unstructured utterances into structured intents, mapping unstructured utterance 'questions' to unstructured answers in a corpus (fundamentally similar search), literal parsing of utterances to shallow or deep (semantic) parses, and so on. The thoroughly end-to-end, multi-modal and multi-scoped task of participating in a conversation remains largely unsolved. As any non-primitive interaction with Siri or Alexa should indicate. Word of the day is "brittle".