Hey hn, this is Tomás, founder of Not Diamond. Today we're open-sourcing RoRF (Routing on Random Forests), a pairwise AI model router that beats all closed and open-source approaches, along with 12 pre-trained model routers:
When routing between two strong models, RoRF achieves higher accuracy than either individual model at significant cost reductions. When routing between a strong and a weak model pair, we outperform other routing approaches at a lower cost.
The architecture for RoRF is based on a Random Forest Classifier and supports both open-source embedding models like Jina which you can run locally, or closed-source embedding models like Voyage or OpenAI for lower compute requirements.
We developed RoRF earlier this year as a previous iteration of the more powerful router we released through our API. Excited to share this :)
t5-notdiamond|1 year ago
Hugging Face: https://lnkd.in/gE4FKZWR Github: https://lnkd.in/gn2uKWaY Blog: https://lnkd.in/gutaamm4
When routing between two strong models, RoRF achieves higher accuracy than either individual model at significant cost reductions. When routing between a strong and a weak model pair, we outperform other routing approaches at a lower cost.
The architecture for RoRF is based on a Random Forest Classifier and supports both open-source embedding models like Jina which you can run locally, or closed-source embedding models like Voyage or OpenAI for lower compute requirements.
We developed RoRF earlier this year as a previous iteration of the more powerful router we released through our API. Excited to share this :)