[samholmes]

I'm excited about this idea. I don't like using non-open source thing because I like to know that I'm investing in something which I can tweak and contribute to. Open source is all around a better idea.

I also like the idea of using on-prem models. As open source LLMs get better and hardware gets cheaper, I can see being able to use local models being the winning advantage.

Please give me early access!

[andrewpareles]

We really like about on-prem models as well - it definitely seems they will get comparable and win over paying for API credits.

Will make the first batch of releases ASAP!