[fzzzy]

Yeah they are. llama.cpp has had good performance on cpu, amd, and apple metal for at least a year now.

[tomrod]

Thw hardware is not the issue. It's the model architectures leading to cascading errors