There are diffusion-based models and transformer-based models (and many other "architectures"), so your comment does not make sense.
But also, no one really knows as they're closed.
I've heard of attempts to use diffusion models to generate text or code as well, but my impression is that it just didn't yield the level of results necessary to dethrone a frontier transformer model.