top | item 44726445 (no title) msikora | 7 months ago With 48GB MAcBook Pro M3 I'm probably out of luck, right? discuss order hn newest simonw|7 months ago For this particular model, yes.This new one from Qwen should fit though - it looks like that only needs ~30GB of RAM: https://huggingface.co/lmstudio-community/Qwen3-30B-A3B-Inst... omneity|7 months ago It takes ~17-20GB on Q4 depending on context length & settings (running it as we speak)~30GB in Q8 sure, but it's a minimal gain for double the VRAM usage.
simonw|7 months ago For this particular model, yes.This new one from Qwen should fit though - it looks like that only needs ~30GB of RAM: https://huggingface.co/lmstudio-community/Qwen3-30B-A3B-Inst... omneity|7 months ago It takes ~17-20GB on Q4 depending on context length & settings (running it as we speak)~30GB in Q8 sure, but it's a minimal gain for double the VRAM usage.
omneity|7 months ago It takes ~17-20GB on Q4 depending on context length & settings (running it as we speak)~30GB in Q8 sure, but it's a minimal gain for double the VRAM usage.
simonw|7 months ago
This new one from Qwen should fit though - it looks like that only needs ~30GB of RAM: https://huggingface.co/lmstudio-community/Qwen3-30B-A3B-Inst...
omneity|7 months ago
~30GB in Q8 sure, but it's a minimal gain for double the VRAM usage.