Super cool, congrats on the launch - will be trying this soon! I noticed it’s using Tauri - what are your main takeaways from building a local inference desktop app with it?
Super cool, congrats on the launch - will be trying this soon! I noticed it’s using Tauri - what are your main takeaways from building a local inference desktop app with it?
Thanks. I learned that running a server on the Rust side and calling it from a TypeScript frontend is a good approach. For example, we run an OpenAI-compatible server using a Tauri plugin (https://github.com/fastrepl/hyprnote/tree/main/plugins/local...) and call it using the Vercel AI SDK.
I wanted to build this for myself. Could never figure out how to get audio output from Mac. Tried almost all audio loopback driver (Blackhole, Soundflower ...). There was problem everywhere wrt security.
Even tried making a teams meeting bot. But Teams doesn't give live audio to developer unless you are a special partner.
Glad you made this. Will play around
Great! We use AudioTap api
great to see that you like it :)
I’ve been thinking about ways to reuse Vercel’s AI SDK, so this is a great one - thanks for sharing!
Also you might find this interesting:
https://github.com/fastrepl/hyprnote/blob/main/packages/util....
Super neat! You’ve made an impressive amount of cool specialized crates - have you considered making them generally usable to the wider community and licensing them under LGPL/MIT instead of GPL?
we def considered it. our line of thinking is start with more restrictive license, and later switch to MIT or something once we figure things out :)