top | item 46817018

(no title)

pietz | 1 month ago

Isn't it obvious that an agent will do better if he internalizes the knowledge on something instead of having the option to request it?

Skills are new. Models haven't been trained on them yet. Give it 2 months.

discuss

order

WA|1 month ago

Not so obvious, because the model still needs to look up the required doc. The article glances over this detail a little bit unfortunately. The model needs to decide when to use a skill, but doesn’t it also need to decide when to look up documentation instead of relying on pretraining data?

velcrovan|1 month ago

Removing the skill does remove a level of indirection.

It's a difference of "choose whether or not to make use of a skill that would THEN attempt to find what you need in the docs" vs. "here's a list of everything in the docs that you might need."

sothatsit|1 month ago

I believe the skills would contain the documentation. It would have been nice for them to give more information on the granularity of the skills they created though.