?

BERT was 5 years ago. Of course it's worse than anything introduced more recently (both inside and outside Google).

https://en.m.wikipedia.org/wiki/BERT_(language_model)