top | item 36333611

(no title)

aiappreciator | 2 years ago

This seems like a very promising product, a ChatGPT interface, enterprise version, is a large gap in the market.

However, this part in your advertising, sounds very dubious:"Credal can be deployed fully on-premise for Large Enterprises, including the large language models themselves"

What do you mean the LLMs themselves? Open source I can understand, how are you going to move GPT-4 to on prem? OpenAI is not giving you the weights.

discuss

order

r_thambapillai|2 years ago

Thanks for your encouragement and that is a totally fair criticism - when we say that, we mean two things:

1. We support using Credal with your own, open source LLM, which can of course be fully on prem in every sense

2. We also support using Credal with your own Azure OpenAI instance. As you say, OpenAI aren't giving us the weights, but many of our customers have procured Azure OpenAI from Microsoft and then we point GPT 4 usage at their Azure instance, meaning that the data never goes to Open AI at all.

One of the things that's going to be really interesting to see moving forward is whether the open source models are going to be able to compete with the blistering pace and funding that the closed source ones - Bard, Claude, and GPT-X are going to be able to attract (and maybe Mistral?). For the sake of the industry, I really hope that the OS models catch up but given the amount of funding (and now in OpenAI's case, revenue) the closed source models are generating, its hard to see how that happens