top | item 42491739

(no title)

dhruvdh | 1 year ago

Which algorithm you pick for what shape of matrices is different and not straightforward to figure out. AMD currently wants you to “tune” ops and likely search for the right algorithm for your shapes while Nvidia has accurate heuristics for picking the right algorithm.

discuss

order

0-_-0|1 year ago

Nvidia's heuristics are not accurate, and it's not possible to achieve peak performance without search.