I am about to catch a flight, so I am unable to do anything better than skimming the post and paper. But isn't this just the good old feature embeddings coupled with learnt features that have been around for several years by now?