top | item 47201727

(no title)

__mharrison__ | 1 day ago

Were you using mlx-lm? I've had good performance with that on Macs. (Sadly, the lead developer just left Apple.)

Admittedly, I haven't tried these models on my Mac, but I have on my DGX Spark, and they ran fine. I didn't see the slowdown you're mentioning.

discuss

order

mstaoru|18 hours ago

(I think) yes, via the latest openwebui + ollama.