Why not use something like litellm?

That's also one option, we will consider add it later :)