top | item 14838682

Second version of HoloLens HPU will incorporate AI coprocessor

142 points| itamarb | 8 years ago |microsoft.com | reply

87 comments

order
[+] ratbr|8 years ago|reply
Serious question: what is an AI coprocessor technically? Some machine learnt models burned on a chip? Or some kind of a neural net with updatable weights?
[+] dgacmu|8 years ago|reply
One example is: https://arxiv.org/abs/1704.04760

There are many potential designs for these things, but the first gen TPU is one that works, is in production, and has been described in a paper. But you have to differentiate if you mean an inference engine, or something that can also do training. For HoloLens, it's probably going to be an inference unit, which means it'll possibly look something like a TPU, perhaps with more specific hardware support optimized for convolutions (which are very important for visual processing DNNs these days), as the NVidia tensor units are.

[+] arcanus|8 years ago|reply
It is not well documented by anyone. However, the expectation is that it is a matrix or convolution coprocessor, as this is a common operation in deep neural networks (for both inference and training). For instance, NVIDIA says they are supporting 4x4 convolutions with the tensor unit.
[+] danmaz74|8 years ago|reply
The AI coprocessor is probably the first processor designed directly by the marketing department...
[+] chriskanan|8 years ago|reply
I was in the audience at CVPR when it was presented. They were doing semantic segmentation using resnet-18, so I'm guessing it speeds up convolutions and some linear algebra during inference. I'm guessing it won't be used for training.
[+] hatsunearu|8 years ago|reply
A whole butt ton of GPU-style FMA and low precision float multiply ALUs would be my guess
[+] WorldMaker|8 years ago|reply
According to the linked article, this coprocessor seems particularly focused on Deep Neural Networks (DNN), so it does sound like a updatable weight neural network evaluator.
[+] Eridrus|8 years ago|reply
Probably also enough high speed memory to store the weights without needing to go to RAM.
[+] zitterbewegung|8 years ago|reply
I used a Hololens and it was awesome (it fit over my glasses). Inference on Hololens could make you do so much more. Maybe you could use it to take scans of parts from a CNC or the CNC tool and create a system that could tell you if a similar piece will fail in the future. From what I have seen compared to Google Glass I think it could be possible for richer interactions and also it uses both eyes. But, I haven't heard any Enterprise users use Hololens.
[+] Pigo|8 years ago|reply
We got a couple at my company and I've built some protoypes for it, and threw up a little blog for it. The cool thing is the HoloToolkit which seems to be maintained by some xbox developers, and scripts all the functionality you need to get off the ground.

The hard part has been coming up with prototypes that go beyond a cool experience, and solve some customer's problem. It doesn't recognize what it's looking at, as much as it's just recognizing the shape of what it's looking at. You have to write the functionality to then determine what it is. Though the HoloToolkit does have scripts that will recognize walls, floors, tables. But it falls really short of the wild ideas my co-workers come up with. There are some example projects out there that will show you how to determine faces, which is cool. But the best ideas most people have, the beta Skype app already knocks it out of the park.

[+] cmac2992|8 years ago|reply
One of the best Enterprise uses I've heard for hololens is measuring spaces. The voices of VR podcast described a company that installs stair lift. Before theyd have to have multiple people come and take lots of measurements before the install. Now it's just one person who can get all measurements in less than 15 minutes.
[+] Balgair|8 years ago|reply
The use cases are pretty varied. We're using some for a medical study looking to see if the HL can help lessen pain through distraction (tested against normal distractions like iPads). The HL is nice, as it lessens incidents of simulator sickness. We're also trying to get the thing to be used to scan the homes and backyards of long-term stay patients so that they can 'go back home' for a little bit while hooked into the hospital. Honestly, in our experiences, it seems like the best use of VR is 'live' events like concerts, sports games, minecraft, etc.

As an aside, you know you are a real adult when you are given the HL for the first time ever, full of 3-d potential and amazing sound and all the coolest things your 10 year-old-self could think of, and you immediately dive into the wireless and firewall settings.

[+] akvadrako|8 years ago|reply
Any idea who makes it? It's probably close in architecture to GPUs, the kind of thing Nvidia and AMD are positioned to capitalise on.
[+] restricted_ptr|8 years ago|reply
They used customizable DSPs from Tensilica. I wonder if this is based on the same technology.
[+] zebrafish|8 years ago|reply
I was thinking it might be closer in spirit to AMD's APU which combines graphics and compute onto the same chip.
[+] deepnotderp|8 years ago|reply
I'm guessing it's close to the tpu design, ie a systolic matrix multiplier.

Other possible candidates include INT8 DSPs

[+] arcanus|8 years ago|reply
I suspect it will have more in common with mobile GPUs than the big iron ASICs that come from NVIDIA or AMD.
[+] 0xffff2|8 years ago|reply
Side note in case anyone at MS happens to read this, but the only actual content on this page that appears above the fold for me (viewing on a Surface Pro 4) is the headline, which is pushed nearly to the bottom of my display by all the headers/nav/whitespace. This strikes me as remarkably bad design.
[+] freehunter|8 years ago|reply
I don't know if it's designed to do that or not, but that's been a huge trend for a few years now. I still have people request that I design a site like that, where the only thing visible by default on the homepage is a 68pt logo and on specific pages is a 68pt title. A navbar at the top and a navbar under the logo are also requested, both navbars displaying the same options.

I don't get it either.

[+] 0xbear|8 years ago|reply
I hope it also contains a decent CPU. The first version has a ridiculously underpowered Atom with no vector capability of any kind. Not the kind of thing you would expect in a $3000 device.
[+] clmckinley|8 years ago|reply
I agree that you would expect more from a $3000 computer, but that is not what hololens is. Considering all of novel sensors and capabilities with the hololens, it is pretty amazing to me that the hololens is only $3000.
[+] markingram|8 years ago|reply
For people who understand neural networks, this is HUGE! I have been dreaming for a custom chip for neural networks for 5 years! If they pull it off and deliver a product launch in a year or two, then they would smoke the competition again.
[+] Symmetry|8 years ago|reply
Google has had their TPU out for a while now. And the next generation of NVidia GPU is supposed to have neural network accelerating hardware.
[+] make3|8 years ago|reply
Are you kidding me. This is basically a marketing name for an 8bit gpu
[+] mtgx|8 years ago|reply
But will it be anymore practical to use than the first version?
[+] tanilama|8 years ago|reply
You mean a matrix multiplication processor?
[+] ori_b|8 years ago|reply
You mean headless GPU? (Or, in some cases, DSP?)
[+] ramshanker|8 years ago|reply
I remember HoloLens being announced to be available in "windows 10 timeframe". Still awaiting (EDIT:) Cheaper consumer version.
[+] wlesieutre|8 years ago|reply
If Windows 10 is the "forever" version of Windows with continuous upgrades then they've got plenty of time!
[+] connorcpu|8 years ago|reply
They're not really focused on making a consumer version, they're trying to turn it into an enterprise product first
[+] WorldMaker|8 years ago|reply
The "cheaper consumer version" focus for now seems to be on the Windows 10 Mixed Reality goggles coming out in the Fall. Yes, it's not HoloLens displays (it's classic LCD screens strapped to your face) or standalone computer (it's tethered to a PC), but it is cheaper and it will be consumer focused in the Fall (and it will use most of the same Windows platform support and niceties like inside-out tracking).
[+] dingo_bat|8 years ago|reply
Well windows 10's time frame is now "as long as Microsoft is in business". It's going to be a series of beta quality builds until eternity.
[+] dsr_|8 years ago|reply
Is it time to recognize that "AI" is the meaningless buzzword of 2017?

"Nothing is cooler because it is cyber." -- J.D. Falk, RIP.

[+] deelowe|8 years ago|reply
How is AI meaningless? I mean, I guess the term can be seen as silly, but I mentally map it to "statistical computing."

[edit] Since I'm getting down votes, can someone clarify? I wasn't being contrarian with the above comment. Is my mental map of what AI means as an industry term incorrect?

[+] nsxwolf|8 years ago|reply
Next they'll add AI to the Juicebro.
[+] yread|8 years ago|reply
"AI" might be, "AI ASIC" is pretty cool though!
[+] seanmcdirmid|8 years ago|reply
AI has been a word since McCarthy coined it in 1955. It is always "just around the corner", but it is hardly a meaningless buzzword.