bpw is the way to compare. huggingface has standard tags that must be used so it forces anyone releasing models to choose a tag that doesn't necessarily equal the actual bpw.
bpw is the way to compare. huggingface has standard tags that must be used so it forces anyone releasing models to choose a tag that doesn't necessarily equal the actual bpw.
It's a bad way to compare. Average bpw ignores the fact that some layers can tolerate more aggressive quant than others.