Their PoC chips are big, but then it's ridiculously fast (have you seen chatjimmy.ai?). Also they must be holding a bunch of patents.
Their PoC chips are big, but then it's ridiculously fast (have you seen chatjimmy.ai?). Also they must be holding a bunch of patents.
Its a cool demo, but its gpt-3.5 level stupid, or worse.
edit: Ok, I will self-apologize. Its apparently a 3B model. Mighty impressive for what it does.
It's a quantised 8B model (Llama 3.1 8B to be exact).
[1] https://taalas.com/the-path-to-ubiquitous-ai/