Sorry for the sidetrack, but why is it so common to consider BERT something else than an LLM? It is one of the earliest LLMs so it's nowhere near the size of more recent ones, but even wikipedia classifies it as an LLM:
Bidirectional encoder representations from transformers (BERT)
Original author Google AI
Release October 31, 2018[1]
Type
Large language model
Transformer
Foundation model
License Apache 2.0
Website arxiv.org/abs/1810.04805
Repository github.com/google-research/bert
https://en.wikipedia.org/wiki/BERT_(language_model)And in any case it's an autoregressively-trained Transformer, albeit encoder-only. If it's not an LLM, then what is it?