I think the main issue with removing certain previous responses from context would be that you no longer hit the cache for a large part of your chat history, which makes responses much more expensive and slow.
Its faster and cheaper (in most cases) to leave the history as is and hit the cache.
No comments yet.