top | item 44846431

(no title)

semessier | 6 months ago

still looking for vLLM to support Mac ARM Metal GPUs

discuss

order

baggiponte|6 months ago

Yeah. The docs tell you that you should build it yourself, but…

tough|6 months ago

but unlike cuda there's no custom kernels for inference in vllm repo...

I think