top | item 37945494

(no title)

idkyall | 2 years ago

Very excited for access to more RAM in a consumer form factor - by comparison, the most RAM you can get on a DDR5 motherboard is 128GB(actually, there may be 48 GB modules as well, so maybe 192), but at that capacity you're not getting anywhere near the rated speeds. The listed 1TB of capacity sounds super roomy by comparison

discuss

order

jadbox|2 years ago

What are ye using all that ram for? -curious stranger

tyfon|2 years ago

I have 128 GB in my computer with a 5850x, it allows me to run and load the 180B falcon and 70B llama2 LLMs in llama.cpp, although with different quantization.

Speed is actually not that bad either.

at_a_remove|2 years ago

One underused angle for oodles of memory is the humble ramdisk. If you haven't run into these, you set aside a portion of memory to serve as a disk volume. If you have a temporary work product, some kind of intermediate stage bit you will not save, shoving it in a ramdisk provides some really amazing speedups. You can put a SQLite database in it on the fly, just for analysis, run at blazing speeds, keep the results. Image an optical disk into your ramdrive, chow away at it, keep the work product, and just clear the memory.

iopq|2 years ago

Try searching deep into the game tree in go. After a few million nodes you can't actually store them all in 16GB of RAM. That's just a day of searching on a 2060, you can get into the hundreds of millions with a faster GPU and a longer search horizon. But when you put it into swap, it won't be as fast...

taskforcegemini|2 years ago

It can't be for tabs in chrome, that browser can't even use all 64gb I offer it ("putting tabs to sleep" is disabled on purpose as I need the tabs to stay active)

itsboring|2 years ago

Isn’t it obvious? More browser tabs.

Washuu|2 years ago

Spillover from my video card's 24GB when doing huge renders in Blender.

swarnie|2 years ago

64gb -> OS, light gaming, 6 oracle DB's and a few middlewares.

smcleod|2 years ago

Definitely 192.