top | item 40367155 (no title) cathalc | 1 year ago Absolutely. Gemini results tend to drop off after 128k tokens according to RULER: https://github.com/hsiehjackson/RULER discuss order hn newest ayyndrew|1 year ago If I'm reading the paper right, it says Gemini 1.5 is good up to 128k, and RULER doesn't test beyond 128k cathalc|1 year ago Hmm perhaps you are right.. There's no context on the page about what ">128k" means so possibly a bad assumption on my part!
ayyndrew|1 year ago If I'm reading the paper right, it says Gemini 1.5 is good up to 128k, and RULER doesn't test beyond 128k cathalc|1 year ago Hmm perhaps you are right.. There's no context on the page about what ">128k" means so possibly a bad assumption on my part!
cathalc|1 year ago Hmm perhaps you are right.. There's no context on the page about what ">128k" means so possibly a bad assumption on my part!
ayyndrew|1 year ago
cathalc|1 year ago