top | item 40645817

Show HN: Relia – Build your own LLM benchmark

3 points| yz-yu | 1 year ago |relia.dev

Relia is an E2E testing framework for LLMs, designed to help you build AI benchmarks tailored to your specific use cases. It identifies the most suitable LLM model for your needs and ensures that model upgrades do not cause performance regressions through continuous testing. Built specifically for function calling (or "tool use") scenarios, which are at the core of agent-based AI applications.

discuss

order

No comments yet.