top | item 43552621 (no title) captaindiego | 11 months ago Are these just good for LLM inference or can they be used to train stuff like CV models too? (Let's say vs. a 5090 which is same ball.park price-wise) discuss order hn newest banderwidthdk|11 months ago From my experience LLM inference really, really likes memory bandwidth, which at 1.79 TB/s the 5090 has quite the lead on the APU's 273GB/s
banderwidthdk|11 months ago From my experience LLM inference really, really likes memory bandwidth, which at 1.79 TB/s the 5090 has quite the lead on the APU's 273GB/s
banderwidthdk|11 months ago