Agreed, "distilled variants" might be more suitable.
Calling them variants is also inaccurate when the pretrained base and architecture are completely different.
Calling them variants is also inaccurate when the pretrained base and architecture are completely different.