top | item 44572115

(no title)

rnxrx | 7 months ago

I'm curious about why the performance gains mentioned were so substantial for Qwen vs Llama?

discuss

AlekseiSavin|7 months ago

it looks like llama.cpp has some performance issues with bf16