It is now possible to grab a pretrained model and start producing state-of-the-art NLP results in a wide range of tasks with relatively little effort.
This will likely enable much more tinkering with NLP, all around the world... which will lead to new SOTA results in a range of tasks.