top | item 42596235

(no title)

detente18 | 1 year ago

Should we expect the current API (https://docs.goodfire.ai/introduction) to be good for prod or is it for testing only?

I see that the sampling API is OpenAI-compatible (nice!). Considering if we can add a native integration for this to LiteLLM with a provider specific route - `goodfire/`. Would let people test this in projects like aider and dspy.

```python

from litellm import completion

import os

os.environ["GOODFIRE_API_KEY"] = "your-api-key"

response = completion( model="goodfire/meta-llama/Llama-3.3-70B-Instruct", messages=[{ "content": "Hello, how are you?","role": "user"}] )

```

discuss

order

No comments yet.