Tried again with a different quant, UD-Q2_K_XL:
https://tools.simonwillison.net/markdown-svg-renderer#url=ht...
... and once more with UD-IQ4_XS
the xhigh version looks amazingly good for a 2 bit quant.
... and once more with UD-IQ4_XS
https://tools.simonwillison.net/markdown-svg-renderer#url=ht...
the xhigh version looks amazingly good for a 2 bit quant.