[underlines]

5070Ti user here: We are 150 people in a SME and most of our projects NDA for gov & defense clients absolutely forbid us to use any cloud based IDE tools like GitHub Copilot etc. Would love for this project to provide a BYOK and even Bring Your Own Inference Endpoint. You can still create licensing terms for business clients.

[hedgehog]

What models do you use that you've found to be powerful enough to be helpful?

[Aherontas]

I have the same question, do you use already an on prem RAG system?