Cellm + Ollamma?
https://docs.getcellm.com/models/local-models
That looks like a great fit! Not sure how I missed it, but I appreciate the link.
That looks like a great fit! Not sure how I missed it, but I appreciate the link.