Some yes, others no. Distillation and quantization can't be used to make new base models since they require a preexisting one.
Some yes, others no. Distillation and quantization can't be used to make new base models since they require a preexisting one.
it enables models larger than was previously possible.
No because the base model from which the distilled or quantized models are derived is larger.