you can try it out here: https://chatjimmy.ai/

that's so fast it feels fake

13,789 tok/s

Well I've gotten one of those "holy fuck this is the future" deeply unsettled anxious feelings in my gut again. It's been a week or 2, it was time.

i only found one discussion of the tech here on HN

https://news.ycombinator.com/item?id=47103661

It's indeed super fast, but the output is complete BS hallucination. Not sure what's the value of this.

It's a proof of concept that it's possible to etch a neural net into a chip and get massive performance (and efficiency) boost