(no title)
jpulec | 2 years ago
We get the benefits of a well used library, which means making certain changes is easy. For example, swapping our vector database was a one line change, as was swapping our cache provider. When OpenAI released GPT-4, we were able to change one parameter, and everything still just worked.
Sure, it's moving fast, and could use a lot better documentation. At this point, I've probably read the entire source code several times over. But when we start testing performance of different models, or decide that we need to add persistent replayability to chains of LLM calls, it should be pretty easy. These things matter to production applications.
mmq|2 years ago
Wouldn't that be the same if you used the OAI js library directly? Basically swapping the model parameter?
jpulec|2 years ago
unknown|2 years ago
[deleted]