This is close to what I need for my company. Currently I'm test driving Open WebUI.

https://github.com/open-webui/open-webui

Stay away, I had bad experience myself, I'm sure there is something better out there. For me I ended up asking Claude to build a custom RAG pipeline, took an afternoon and is 10x faster.