The app is basically just a wrapper that makes it super easy to set this up, which I'm very thankful for. I sometimes want to toy with this stuff but the amount of tinkering and gluing things together needed to just get a chat going is always too much for me. The fact that the quality of the AI isn't good is just the models not being quite there yet. If the models get better, this app will be killer.
If there's a similar app for desktop that can set up the stronger models for me, I'd love to hear about it.
LM Studio does it well. Along with being a system integrator for SD, and text models I've tried to create a very good chat experience. So theres some sauce over there with Prompt enhancements, Auto detection of images, English Transcription suppor, etc
> If the models get better, this app will be killer.
Any random thing might happen in the future.
That doesnt have any bearing on how useful this is right now.
All we can do is judge right now how this compares to what it promises.