Before I started work on it, I looked around at all of the available options, and none of them really fit what I wanted:
- easy to use
- fast
- not a huge desktop app
so I decided to make my own! AirmailAI (if you're not running it locally) is a one-click install from the Chrome Web Store, the TTFT overhead is within 50ms of raw https API requests, and the install size/memory requirements are very reasonable (<2MB on disk, ~60MB RAM while running).
Hmm I see...it's clear now, it would be better if you addedthis moto to the description However great initiative
name some examples. easy to use is opinioned,
Sure. I tried Open WebUI, SillyTavern, AnythingLLM, etc. I wasn't a fan of installing a 500MB desktop app, or having to run a webhost locally, or having to configure a bunch of settings just to chat with the newest LLM.