It's not even just about the slots, it's about the PCIe lanes (which is something I never had to worry until now, though I built countless PCs in the past).
We tried bunch of setups with Threadrippers and EPYC, at the end settled for the ROMED8-2T which is a monster motherboard.
We run 4x 2080s on threadripper systems. What sort of trouble did you run into? I thought threadripper has plenty of PCIe lanes. We didn't have any trouble but it could be I missed something, we had to get it working quick and I didn't do very much benchmarking.
I just built a rig with a Romed8-2T as well. I got pcie 3 16x risers and zip-tied them above the tower into a rack shelf above it. It's super ghetto, and I can't believe it works, but it totally does. I'm hosting on vast.ai hoping someone will train with my 4-6 3090s, but everyone wants their large language models and image generation models that require more than the 24GB of RAM. shrug
Maybe some day I'll use it myself to train my plastic surgery outcome estimation visualization GAN or diffusion model if I can figure out how to fine-tune one.
ftufek|3 years ago
We tried bunch of setups with Threadrippers and EPYC, at the end settled for the ROMED8-2T which is a monster motherboard.
tinco|3 years ago
knicholes|3 years ago
Maybe some day I'll use it myself to train my plastic surgery outcome estimation visualization GAN or diffusion model if I can figure out how to fine-tune one.
johndough|3 years ago
galkk|3 years ago