[nathanfig]

>> I haven’t had great luck with winding it up and setting it loose on a task

Yeah there is real labor involved with trying to set up the right context and explain your goals and ensure it has the right tools, etc. etc. Sometimes the payoff is massive, other times it's like "I could have done this myself faster". It takes time to build an intuition for which is which, and I'm constantly having to tune that heuristic as new models and tools come out.