top | item 44963221

(no title)

robbies | 6 months ago

I’m being earnest: what is an appropriate level of computer architecture knowledge? SIMD is 50 years old.

From the resource intro: > Expected background: We’re going to assume you have a basic understanding of LLMs and the Transformer architecture but not necessarily how they operate at scale.

I suppose this doesn’t require any knowledge about how computers work, but core CPU functionality seems…reasonable?

discuss

order

Symmetry|6 months ago

SIMD is quite old but the changes Nvidia made to call it SIMT and that they used as an excuse to call their vector lanes "cores" are quite a bit newer.