It's a mixed bag. It depends on your problem domain, the problem you are trying to solve (within that domain), the context you provide the LLM, the output it generates (you are using libraries to coerce the output into predictable (JSON) structures, right?). What's more, based on what you are trying to do, the LLM you are using might have sufficient training data, but not necessarily so (resulting in possible hallucinations/confabulations). So, there's that. Also, LLMs are not deterministic, they can (and will) generate a different response every time you call them (even if the context you provided is the same). So, yeah... sometimes these things really deliver and other times, it's just... meh!
No comments yet.