Not necessarily, only ~30% of the database is in English, so it likely won't be as good as a smaller model trained solely or mostly on English words.
https://bigscience.huggingface.co/blog/building-a-tb-scale-m...
https://bigscience.huggingface.co/blog/building-a-tb-scale-m...