I just think that titling a paper about a weighted bag-of-words approach "Context is everything" really starts the reader off on the wrong foot. In fact there's almost no context in your model, in contrast to most other sentence learning methods!
(In practice, this can also be applied outside of language, for the importance of other semantic vectors in context)