sure, here's my conversation with BitNet b1.58 2B4T
here's the same prompt given to smollm2:135m
The quality of the second results are not fantastic. The data isn't public, and it repeats itself mentioning income a few times. I don't think I would use either of these models for accurate data but I was surprised at the truncated results from bitnet
Smollm2:360M returned better quality results, no repetition, but it did suggest things which didn't fit the brief exactly (public data given location only)
Edit:
I tried the same query on the live demo site and got much better results. Maybe something went wrong on my end?
You were using bitnet.cpp?
Yes