top | item 40367155

(no title)

cathalc | 1 year ago

Absolutely. Gemini results tend to drop off after 128k tokens according to RULER: https://github.com/hsiehjackson/RULER

discuss

order

ayyndrew|1 year ago

If I'm reading the paper right, it says Gemini 1.5 is good up to 128k, and RULER doesn't test beyond 128k

cathalc|1 year ago

Hmm perhaps you are right.. There's no context on the page about what ">128k" means so possibly a bad assumption on my part!