top | item 39373986

(no title)

Aqueous | 2 years ago

I thought Observability in this context means the ability to introspectively make sense of why the LLM output what it did, which is a difficult problem because the model parameters are effectively an unintelligible morass of numbers. Does this help with that and if so how?

discuss

order

tracerbulletx|2 years ago

Pretty sure this just structures logs for requests to common 3rd party LLM providers. Which I guess is useful, but it's not some kind of problem unique to LLMs.

Aqueous|2 years ago

Correct- the summary is misleading marketing. This is just normal system / service observability. What people mean by observability in the LLM context is specific.