Some corrections: the vectors are un-rotated in practice for future query vectors. This could be removed with a slightly different LLM arch.
PolarQuant does live on in TurboQuant's codebooks for quantization which borrows from the hyperpolar coords
Some corrections: the vectors are un-rotated in practice for future query vectors. This could be removed with a slightly different LLM arch.
PolarQuant does live on in TurboQuant's codebooks for quantization which borrows from the hyperpolar coords