top | item 47077967

(no title)

tarruda | 10 days ago

> so llama.cpp just doesn't handle it correctly.

It is a bug in the model weights and reproducible in their official chat UI. More details here: https://github.com/ggml-org/llama.cpp/pull/19283#issuecommen...

discuss

sosodev|10 days ago

I see. It seems the looping is a bug in the model weights but there are bugs in detecting various outputs as identified in the PR I linked.