[mardef]

There is no memory that the LLM has from your initial instructions to your later instructions.

In practice you have to send the entire conversation history with every prompt. So you should think of it as appending to an expanding list of rules that you put send every time.

[alpineman]

You can use a RAG / embedding database as a kind of memory and add pulled 'approved examples', 'feedback comments' etc alongside future prompts.