[kaycey2022]

Feels like a minor glimpse into what's involved in running tech companies these days. Sure this list could be much simpler, but then so would the scope of the company's offerings. So AI would offer enough accountability to replace all of this? Agents juggling million token contexts? It's kind of hard to wrap my head around.

[nine_k]

Agents run tools, too. You can make an LLM count by the means of language processing, but it's much more efficient to let it run a Python script.

By the same token, it's more efficient to let an LLM operate all these tools (and more) than to force an LLM to keep all of that on its "mind", that is, context.

[kaycey2022]

Agents are just not deterministic. You will see wierd things like in one thread an agent simply says it cannot access a CLI tool for whatever reason. You inspect the call, it worked just fine in another thread. You eventually shrug your shoulders and close the thread, pick up from another instead of having the agent flail around some obvious BS for hours and hours.

Just because they can run tools, doesn't mean they run them reliably. Running tools is not a be all and end all of the problem.

Amdahl's law is still in play when it comes to agents orchestrating entire business processes on their own.