top | item 36842370

(no title)

httgp | 2 years ago

Noob question - are they somehow better at AI/ML workloads than regular x86_64?

discuss

order

panick21_|2 years ago

Well, of course I don't have performance numbers or anything.

In general, the RISC-V Vector Unit has very much been designed to make those workloads faster. Many new AI/ML companies are using RISC-V and Vectors but usually with some of their own non-standard stuff.

Esperanto has Vectors with TPU. TensTorrent has done a lot of work on software to use their chip as a dataflow engine. And so on and so on.

So essentially, Nvida is making a huge amount of money and all those companies will want a piece of it.

I would say RISC-V Vector is a better design then x86 SIMD.

RISC-V is also not done, there are efforts to standardize things like matrix and other things used for AI/ML workloads.