You might find the journey of Tinycorp's Tinybox interesting, it's a machine with 6 to 8 4090 GPUs and you should be able to track down a lot of their hardware choices including pictures on their Twitter and other info on George his livestreams.
EPYC + Supermicro + C-Payne retimers/cabling. 208-240V power typically mandatory for the most affordable power supplies (chain a server/crypto PSU for the GPUs from ParallelMiner to an ATX PSU for general use).
osmarks|1 year ago
Keyframe|1 year ago
icelancer|1 year ago
ghxst|1 year ago
icelancer|1 year ago
Beyond that, not much else.
llm_trw|1 year ago
There's a bunch of similar setups and there are a couple of dozen people that have done something similar on /r/localllama.
adakbar|1 year ago