[44za12]

Why not use something like litellm?

[zecheng]

That's also one option, we will consider add it later :)