[lqstuart]

This isn’t how deep learning works. You can’t just “adjust weights” for some random user/product.

I feel like even otherwise intelligent people these days think these chatbots are Westworld-like programmable AIs and not pieces of shit that barely run or work. There is no tech monolith that’s getting advanced and gaining new capabilities. There are some very smart people who have switched from building ad recommenders or autonomous vehicles to building KV caches and reinforcement learning systems, and then in a different department there are the same people who built ads systems at whatever big tech company that will build the same shit at OAI etc.

[toraway]

Isn't that literally what post-training/fine-tuning does?

[ndriscoll]

You don't need to adjust the weights. Just have it query a vector database of current ad campaigns to find a PROMPT.md to inject when the context is relevant. e.g. user is talking about camping -> lookup ad campaign documents relevant to camping (e.g. with embeddings) -> inject prompt about the campaign. This is all basically obvious if you've been using SKILL.md for agents at work.