Just use Plexus [1]. The maintainer is not trying to be a hero or raise seed dollars or even really trying to promote it. He's just making an excellent, useful product. (Unaffiliated, just a happy user). It's not a full-on "LLMOps" platform (whatever that is), it's just a proxy that works very well and has some nice features.