FlauBERT and Flue: French Bert
github.com
github.com
> FlauBERT is competitive with CamemBERT (Martin et al., 2019) – another pre-trained language model for French – despite being trained on almost twice as fewer text data.
Clearly they didn't run that through the English BERT because no language model would assign high probability to that phrase!