I used that to Generate an SVG of a pelican riding a bicycle:

https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

It took 18 minutes 20 seconds. Pretty decent for a 5.5GB model file.

How does that compare with the bf16 version?

For my "Please recite Jabberwocky" test the bf16 almost passes but the ternary and even fp8 versions fail badly.

M1 Pro, same prompt, same cli options:

  32,706 tokens
  38min 19s
  14.22 t/s
[deleted]

Honestly looks pretty good except whatever is going on with its booty. Is that an ass helmet? I cannot parse what's going on there.

Like you've never worn an ass helmet

Only because I hadn't previously thought of it xD Step up from the standard ass-hat for sure.

I think it’s supposed to be a wing

I like the lens effect behind the rear tire.