[Zetaphor]

I keep reading comments saying it's useless from people who clearly haven't actually used it.

I'm building and using this machine daily for building and using applications with LLMs, TTS, STT, ASR, and image generation.

[androiddrew]

Yeah, there is a lot of advantage to having this machine because the CUDA stack is still king. My Two AMD GPUs are suffering when it comes to working with ROCm stack. I have forks of Ollama and VLLM that took many weekends to figure out.

[Zetaphor]

If you're on Strix Halo, check out Donato's prebuilt toolboxes for ROCm with RADV or Vulkan:

https://github.com/kyuz0/amd-strix-halo-toolboxes

It takes all the work out of it, you just start llama-server in the container context and you're off doing inference without having to figure out dependencies.

[EnPissant]

Which, GB10 or Strix Halo?

[androiddrew]

Pretty sure they mean the GB10

[Zetaphor]

Strix Halo