There are diffusion-based models and transformer-based models (and many other "architectures"), so your comment does not make sense.
There are diffusion-based models and transformer-based models (and many other "architectures"), so your comment does not make sense.
Are there any diffusion-based or otherwise non-transformer-based models in mainstream use?
If you include non-language models, yes.
If by mainstream you mean "ChatGPT" or "Claude", then no.
But also, no one really knows as they're closed.