top | item 45602519

(no title)

hmottestad | 4 months ago

I don't think anyone is pretending that a Macbook Pro can compare to 8 H100 cards from Nvidia in terms of LLM training or for serving LLMs. But you can buy an awful many macbooks for the price of 8 H100 GPUs.

But if your workload belongs on 8 H100 GPUs then there isn't much point in trying to run it on a macbook. You'd be better served by renting them by the hour, or if you have a quarter million dollars you can always just purchase them outright.

The H100 is just an example, this is true for any workload that doesn't fit on a laptop.

discuss

order

No comments yet.