For single-purpose LLM tools, I personally prefer ollama. idk if you can make the provider agnostic or not