top | item 41360002

(no title)

jfarlow | 1 year ago

Clearly RAM-stingy Apple has found a use for RAM - almost certainly in loading local LLMs.

Llama 8G loads and runs pretty well on the new M-series Macs with a reasonable amount of RAM.

discuss

order

okdood64|1 year ago

Does it run well with 16gb?

layer8|1 year ago

It even runs fairly well on the 8 GB base model.