[danshalev7]

Nice, which other models does this support?

[gkorland]

It practically supports every models out there, LiteLLM supports over 100 large language model services, including OpenAI, Claude, Gemini, WatsonsX, Mistral, Azure OpenAI, Sagemaker....