top | item 39770324

(no title)

brucethemoose2 | 1 year ago

But is this going to blow over in a few days? Again?

I can certainly appreciate frustration with the AMD stack, but be blunt, I was not impressed with Hotz's YouTube rant from before.[1] It didn't give the impression of a stable framework, and this doesn't either.

Also (at least from the end user llm inference side of things) ROCm is not nearly as unusable as it used to be. We would certainly be renting MI300s over A100s (or even H100s) if we could get any, and we use a number of different inference backends.

1: https://news.ycombinator.com/item?id=36193625

discuss

order

whalesalad|1 year ago

he's always been nails on a chalkboard for me. rant, whine, cry, repeat. reminds me of larry david with a CS degree.

brucethemoose2|1 year ago

I never followed Hotz, so perhaps I missed something cool. But I never understood the hype myself.

jauntywundrkind|1 year ago

The post PC era of big expensive hardware you can't even buy if you do have the money is upon us, and mercy this is a scary scary time in computing for me/us.

brucethemoose2|1 year ago

I was talking about renting!

There are some boutique hosts like Hot Aisle serving MI300s (who I really should reach out to), but for the immediate future our little startup is stuck with the big cloud providers. No MI300s for us mere mortals, not even to rent.

smoldesu|1 year ago

Besides the datacenter stuff, what exactly are people struggling to source these days? The 30/40-series prices should be fairly stable relative to the MSRP these days.

pjmlp|1 year ago

Yet another thing to go back to 1990's ecosystem. We already have timesharing again, now we have the prices as well.