I've been doing research with NLP for about 5 years now I couldn't have created a better inrto list than this. Many of these resources were things I've sent people over the years.
Do BERTs models learn faster than GPTs?
Assuming the task is predictive, BERT seem to have a stronger/richer signal (obviously in practice you have use existing pre-trained models)