>> Small models, slightly improved, probably still not good enough for the same use as online models. Nothing wrong with incremental progress, however.
An even smaller language model should still be useful as part of a speech-to-text system. These should benefit from using the language model to narrow down what word is spoken in the face of ambiguity or noise.