[shahules]

Thanks for your feedback. We have tested Ragas on alternatives like Claude, Mixtral, Gemini, etc.

Although we support all LLMs supported by Langchain, sadly many of the OSS models out of the box aren't capable of generating JSON-type output which is important for us to ensure reproducibility.

[jfisher4024]

Any tips for Mixtral? That’s what we tried

[shahules]

Hey, I would recommend checking out our PRs. There would be PRs that have modified some of the prompts to better suit Mixtral.