top | item 39647404 (no title) OOPMan | 2 years ago Ah yes, 24gb top-of-the-line GPUs, I happen to have a whole warehouse full./s discuss order hn newest jph00|2 years ago Fair -- 24GB GPUs are still quite expensive. >10x cheaper than 80GB GPUs though!We already have something we're testing that's gotten 70b training down to dual 16GB GPUs, and we're working it making it even smaller...
jph00|2 years ago Fair -- 24GB GPUs are still quite expensive. >10x cheaper than 80GB GPUs though!We already have something we're testing that's gotten 70b training down to dual 16GB GPUs, and we're working it making it even smaller...
jph00|2 years ago
We already have something we're testing that's gotten 70b training down to dual 16GB GPUs, and we're working it making it even smaller...