Are there any diffusion-based or otherwise non-transformer-based models in mainstream use?
I've heard of attempts to use diffusion models to generate text or code as well, but my impression is that it just didn't yield the level of results necessary to dethrone a frontier transformer model.
But also, no one really knows as they're closed.