Theoretically, it could support over 140 languages, as it is powered by the newly released Gemma 3n model. However, I haven’t tested many languages yet.
In upcoming releases, Refine will support custom prompts and BYOK (Bring Your Own Key), allowing you to use any large language model you want.
What's the rationale behind adding BYOK? Or the advantages?
You do realise you're already using an optimised model built for everyday devices, and that model includes some serious innovations in parameter-efficient processing, right?
You're a great developer, and it looks like you're thinking about adding features like BYOK quickly to please more users. But in doing that, you might be missing the real innovation you've already created. You've basically built a version of Grammarly without the privacy issues that make most IT departments ban it.
No one wants Grammarly or your tool sending corporate emails or documents to a language model. Privacy is what sets you apart from Grammarly. It's your biggest feature right now. Add a big table to your site comparing your products privacy with Grammarly's. That's your strongest selling point, and probably the only feature that can truly compete with the big players.
My advice? Keep improving the app, but keep the model local. Keep it private. That's the killer feature you've got.
Theoretically, it could support over 140 languages, as it is powered by the newly released Gemma 3n model. However, I haven’t tested many languages yet.
In upcoming releases, Refine will support custom prompts and BYOK (Bring Your Own Key), allowing you to use any large language model you want.
What's the rationale behind adding BYOK? Or the advantages?
You do realise you're already using an optimised model built for everyday devices, and that model includes some serious innovations in parameter-efficient processing, right?
You're a great developer, and it looks like you're thinking about adding features like BYOK quickly to please more users. But in doing that, you might be missing the real innovation you've already created. You've basically built a version of Grammarly without the privacy issues that make most IT departments ban it.
No one wants Grammarly or your tool sending corporate emails or documents to a language model. Privacy is what sets you apart from Grammarly. It's your biggest feature right now. Add a big table to your site comparing your products privacy with Grammarly's. That's your strongest selling point, and probably the only feature that can truly compete with the big players.
My advice? Keep improving the app, but keep the model local. Keep it private. That's the killer feature you've got.
One can have a beefier server at home and may want to use it for running the model while out and about with their laptop.