top | item 28485295

(no title)

ramzyo | 4 years ago

This is really impressive work. Would be interested to know whether they plan to support ARM CPUs in their runtime engine (currently looks like just a few AMD & Intel CPUs: https://github.com/neuralmagic/deepsparse). Many IoT and embedded devices with application-class processors could benefit from these speedups.

discuss

ddv|4 years ago

"Is there plan to support sparse NN influence on mobile devices, such as Arm CPUs?"

"Based on the amount of work for support, it's on our medium to long-term roadmap currently."

https://github.com/neuralmagic/deepsparse/issues/183

monocasa|4 years ago

And no community pitching in to help with that either.

> Open sourcing of the backend runtime is something we're not planning for the near to medium term. It is something we're actively reevaluating, though, as the company and the industry as a whole grows to see what works best for the needs of our users.