new | ask | show | jobs
tgtweak 3 hours ago  [ - ]

Citing full precision benchmarks then just going with 4 bit quants

IsTom 17 minutes ago  [ - ]

It's natively Q4.