To clarify for people familiar with the names but not what corresponds to what:
BERT - Encoder-only - embeddings for downstream tasks
GPT/OPT/etc - Decoder-only - language generation
T5/T0 - Encoder-decoder. Kind of does both?
BERT - Encoder-only - embeddings for downstream tasks
GPT/OPT/etc - Decoder-only - language generation
T5/T0 - Encoder-decoder. Kind of does both?
No comments yet.