top | item 44037882

(no title)

convivialdingo | 9 months ago

When I use the "think" mode it retains context for longer. I tested with 5k lines of c compiler code and I could 6 prompts in before it started forgetting or generalizing

I'll say that grok is really excellent at helping my understand the codebase, but some miss-named functions or variables will trip it up..

discuss

order

pomtato|9 months ago

not from a tech field at all but would it do the context window any good to use "think" mode but discard them once the llm gives the final answer/reply?

is that even possible to disregard genrated token's selectively?