Mostly mask fill, but Transformers can be fine tuned to downstream tasks relatively easily (T5 was built for translation but is used for autocomplete in many cases)
would you mind sharing some references (or even just googleable terms) for this process of fine tuning?