top | item 45097443

(no title)

nickreese | 6 months ago

Is there a framework for this?

discuss

order

CuriouslyC|6 months ago

I have one that's currently still cooking, I have good experimental validation for it but I need to go back and tune the latency and improve the install story. It should help any model quite a bit but you have to hack other agents to integrate it into their api call machinery, I have a custom agent I've built that makes it easy to inject though.

knlam|6 months ago

The best one is google ADK, I must say they are quite thoughful of all the use cases

CuriouslyC|6 months ago

ADK is a nice framework but it's still stuck in the agent as atomic chatbot that goes out and does stuff model. The reality is you want your agents to all be running within an orchestrator service because it's much more efficient in pretty much every way. The way you separate concerns here is to have the agent emit intents, and have those intents go to a queue to be acted upon safely and securely by executors. This system is more secure, performant and observable than the ADK setup.