This is a good product but the naming/branding is pretty unfortunate.
Typesafe.AI sounds like some typescript/structured output type of tool…
What even is “system one” ?
IMO the product/tech is really there, just needs better communication.
This is a good product but the naming/branding is pretty unfortunate.
Typesafe.AI sounds like some typescript/structured output type of tool…
What even is “system one” ?
IMO the product/tech is really there, just needs better communication.
> What even is "system one"
I definitely agree it's underexplained in type safe.ai's materials.
I have to assume it's a reference to the fast, heuristic, intuitive "system 1" process in humans, as opposed to the slow, procedural, reasoning "system 2".
This theory is recognized, among others, in Daniel Kahneman 2002 Nobel prize on Economics.
The model can't reason comprehensively (e.g., like Sol XHigh would to solve a complicated problem), but it's designed to be able to answer anything a human reasonably could quickly and intuitively, i.e., system one thinking: https://en.wikipedia.org/wiki/Thinking,_Fast_and_Slow
I wonder how well it can play chess, or go.
I had a different initial confusion - it seems this company has no relation to the company formerly known as Typesafe https://en.wikipedia.org/wiki/Akka.io
I mean, it's a structured output model that (apparently) can't hallucinate. I don't mind the name.
It can't hallucinate, but it doesn't mean it can't make wrong decisions. Just because it adheres to a specific output format at all time, while LLMs have the output format at their mercy, then the claim of not hallucinating is made technically true.
I think that this specific part is not super interesting if your harness just recovers from invalid LLM outputs.
The latency and cost - yes, those are super interesting.
You can get rigid output format from "classic" LLMs https://docs.vllm.ai/en/latest/features/structured_outputs/ though model support is limited.
Would like to have something like in the original post but open weights.