top | item 44846431 (no title) semessier | 6 months ago still looking for vLLM to support Mac ARM Metal GPUs discuss order hn newest baggiponte|6 months ago Yeah. The docs tell you that you should build it yourself, but… tough|6 months ago but unlike cuda there's no custom kernels for inference in vllm repo...I think
baggiponte|6 months ago Yeah. The docs tell you that you should build it yourself, but… tough|6 months ago but unlike cuda there's no custom kernels for inference in vllm repo...I think
baggiponte|6 months ago
tough|6 months ago
I think