top | item 47108642

(no title)

sleight42 | 8 days ago

Sure but the GPUs are fairly anemic, right? I get that they have more Gpu-addressable memory from the shared pool.

I have a 10900K with 65GB RAN and a 3090 24GB VRAM lying around gathering dust. 24GB isn't as much as a Mac but my cores run a whole lot faster. I may be able to run a 34B 4bit quantized model in that. Granted, the mofo will eat a lot of power.

discuss

order

No comments yet.