[Dansvidania]

That’s not learning. That’s carrying over context that you are trusting is correctly summarised over from one conversation to the next.

[regularfry]

Which sounds uncomfortably like human memory, which gets rewritten from one recollection to the next. Somehow, we cope.

[Dansvidania]

I disagree. Human memory is literally changing the weights in your neural network. Like, exactly the same.

So in the machine learning world, it would need to be continuous re-training (I think its called fine-tuning now?). Context is not "like human memory". It's more like writing yourself a post-it note that you put in a binder and hand over to a new person to continue the task at a later date.

Its just words that you write to the next person that in LLM world happens to be a copy of the same you that started, no learning happens.

It might guide you, yes, but that's a different story.

[0xbadcafebee]

Ever seen the movie Memento? That's LLM memory.