The text encoder is still 4-bit quantized.