top | item 42769596 (no title) z_ | 1 year ago Exolabs claims they can distribute the compute over many machines to use memory in aggregate: https://github.com/exo-explore/exoMaybe there is enough memory in many machines. discuss order hn newest zamadatix|1 year ago That's the general task but the hard part is having the pile of local machines with nearly a TB of VRAM to distribute it on. You'd need over 30 3090s worth of GPUs to run those models.
zamadatix|1 year ago That's the general task but the hard part is having the pile of local machines with nearly a TB of VRAM to distribute it on. You'd need over 30 3090s worth of GPUs to run those models.
zamadatix|1 year ago