top | item 44628960

LLM-in-a-Box: A Templated, Self-Hostable Framework for Generative AI

3 points| geoHeil | 7 months ago |github.com

3 comments

order

geoHeil|7 months ago

Together with www.linkedin.com/in/aaron-cul... I have created a template for making LLMs (from different vendors and even self hosted ones) easily accessible to researchers - including advanced document RAG with docling.

geoHeil|7 months ago

We are currently preparing a submission for JOSE and are looking for feedback but also more people who are interested in joining in and refining the template