I haven't been following the market until recently, but isn't the AMD Ryzen Max AI a consumer friendly AI option? Is it just not serious enough relative to the Nvidia offerings?
Yes, I have an AMD Ryzen AI Max+ chip with memory set to allocate 96 gigs to the GPU and 32 gigs to the CPU. I got it last week, and I've been running gpt-oss-120b at q5 at 40t/s. I run Linux with llama.cpp compiled against ROCm 7.
It works on the GPU, and the NPU is supposed to work on Windows using a framework called lemonade (I haven't tried), but the NPU is not supported with the same software stack on Linux yet.
curt15|4 months ago
rpdillon|4 months ago
jakogut|4 months ago
fooker|4 months ago