"Attention is all you need" should be renamed into "Attention is sufficient but not necessary".
It’s the opposite: attention is necessary but not sufficient.
Just about anyone building a large diffusion model is relying on transformers
A quick look at the continuous diffusion models linked in the post shows lots of transformer models still
It’s the opposite: attention is necessary but not sufficient.
Just about anyone building a large diffusion model is relying on transformers
A quick look at the continuous diffusion models linked in the post shows lots of transformer models still