top | item 40822568

(no title)

cheesyFish | 1 year ago

Hey guys, Logan here! I've been busy building this for the past three weeks with the llama-index team. While it's still early days, I really think the agents-as-a-service vision is something worth building for.

We have a solid set of things to improve, and now is the best time to contribute and shape the project.

Feel free to ask me anything!

discuss

order

haidev|1 year ago

Is this k8s for LLMs?

cheesyFish|1 year ago

Not quite. More like a framework to make LLMs/agents easier to deploy in a distributed fashion. We have a PR that shows how to deploy this with k8s!

CaptainOfCoit|1 year ago

The submitted project is a framework for building programs. Kubernetes is a platform for deploying and running applications. So no.

ramon156|1 year ago

Ah yes, AAAS

cheesyFish|1 year ago

maybe agent micro-services is a better way to frame it ha