How does that compare with the bf16 version?
For my "Please recite Jabberwocky" test the bf16 almost passes but the ternary and even fp8 versions fail badly.
How does that compare with the bf16 version?
For my "Please recite Jabberwocky" test the bf16 almost passes but the ternary and even fp8 versions fail badly.