This is more challenging for robots that it looks to most humans. The phenomenon is called Moravec's paradox.
It also explains why no robot is nearly as agile as a mouse, while computers routinely beat human world champions at many ‘complex’ games.
"Moravec's paradox is the discovery by artificial intelligence and robotics researchers that, contrary to traditional assumptions, high-level reasoning requires very little computation, but low-level sensorimotor skills require enormous computational resources. The principle was articulated by Hans Moravec, Rodney Brooks, Marvin Minsky and others in the 1980s. As Moravec writes, "it is comparatively easy to make computers exhibit adult level performance on intelligence tests or playing checkers, and difficult or impossible to give them the skills of a one-year-old when it comes to perception and mobility".
Similarly, Minsky emphasized that the most difficult human skills to reverse engineer are those that are unconscious. "In general, we're least aware of what our minds do best", he wrote, and added "we're more aware of simple processes that don't work well than of complex ones that work flawlessly"."
"As Moravec writes:
Encoded in the large, highly evolved sensory and motor portions of the human brain is a billion years of experience about the nature of the world and how to survive in it. The deliberate process we call reasoning is, I believe, the thinnest veneer of human thought, effective only because it is supported by this much older and much more powerful, though usually unconscious, sensorimotor knowledge. We are all prodigious olympians in perceptual and motor areas, so good that we make the difficult look easy. Abstract thought, though, is a new trick, perhaps less than 100 thousand years old. We have not yet mastered it. It is not all that intrinsically difficult; it just seems so when we do it."
"difficult or impossible to give them the skills of a one-year-old when it comes to perception and mobility" - hey I can get a robot with vision cameras and a couple of LIDARs to go from point A to B. Better than your one year old.
I'm reminded of a an early Asimov story where mute household robots that are as capable and agile as any human are commonplace, but a computer than can talk is unique in the world and the size of a building.
IKEA furniture! Why didn't I think of that!? I had been thinking of a task like PC building as a test target for teleoperation.
Why isn't teleoperation a more heavily researched area? I suspect that it could be efficiently accomplished with manipulators that are much simpler than human beings or human hands, so long as you add two powerful ingredients:
1) Movable point of view. Basically this could be slaved to the position of a high resolution VR headset. It could even be provided by a tethered drone.
We've had teleoperation for a long time, but it has generally been hampered by a static point of view. What if you could crane your neck and look around what you are doing? This greatly improves the intuitiveness and effective bandwidth of the interface.
2) Haptic feedback.
If you can feel what's happening, even indirectly, it also greatly improves the quality of the interface. Think of the dexterity you have with a pair of forceps or needle nose pliers, versus the dexterity you'd have with those while your hands are numbed by novacaine. Since such mechanisms would be much simpler than a mimic human arm, they'd be much cheaper. Also, human beings are very adaptable to control tasks and don't really require a precise mimic of human limbs. (Witness the amazing feats of backhoe control you can find on YouTube.)
There was a huge amount of teleoperation research done for the DARPA robotics challenge and there still is for things like servicing satellites. Movable points of view and haptic feedback are not enough to solve teleoperation. A big problem with teleoperation is lag and packet loss. A majority of the applications where teleoperation makes sense involve a great distance between the operator and the robot, situations where these two factors become problematic. While a movable view would be useful, the lag between headset motion and camera motion could be nauseating. In the DARPA robotics challenge, competitors were able to create movable views with lag by 3d scanning the environment and streaming the 3d scans.
Haptics can greatly degrade with lag. There have been some approaches to predict what the operator is going to do or predict that a collision is going to occur and prevent such things, but they have not been able to decrease the time it takes to complete a task[0].
It is worth noting though that remote surgery has been somewhat successful over high bandwidth communication links. One constraining factor for teleoperation research is that there aren't many applications where it makes sense to do so. The problem is that robots and haptic gear are currently expensive which limits the applications. You need an application where humans cannot go or the labor the operator is doing is more valuable than the cost of transporting the operator there and the robot. Applications where humans can't go are fairly niche. In addition, applications like working inside a non-damaged nuclear reactor or subsea operations tend to involve equipment that has been designed to be serviced by the simplest of teleoperated robots. In the case of nuclear reactors, mechanical and hydraulic remote manipulators are suitable for most operations. Very valuable tasks like robot surgery are rarely done remotely, partially because of how expensive surgical robots are. We could put surgical robots in remote locations, but remote locations have less patients to service, so it's hard to justify the cost of putting robots in a bunch of remote locations versus moving the patients to the hospitals.
This is a pretty big advancement. Robots have been able to assemble products for years in structured environments with lots of expensive programming, so it has only made sense to use them to assemble lots the same thing, things humans can't touch, or things valuable enough to justify the cost. They have been able to do assembly in an unstructured environment. that is they don't need any markers on the chair pieces and the chair pieces don't need to start in exactly the same place. They still need to do some programming specific to the chair, but the amount of programming they have to do is less. Whereas before one might have to specify the exact motion the arms need to go through or how to pick up one specific part and move it around, they are able to specify the tasks the robot needs to do at a higher level. They do remark that working at this high level is still fairly difficult, but still a very large advancement. The icing on top of the cake is that they were able to do all this with relatively low cost hardware.
Now before we can see this approach used in practical applications, they are going to have to improve the reliability of assembling things. If the reliability of manipulating things can be improved, this could be very disruptive. I think that near term, the killer app for this is an autonomous robotic welding cell. In 2012 it was shown that welding work for a vehicle frame could be autonomously planned[0]. Robot manipulation was not good enough at the time, so the robot had to tell the human where to put all the fixtures and pieces to weld and then welded them. The human also had to reorient the parts too. The implication of this work, is that many of the operations they used to make the chair are also applicable to autonomous welding. This could be very disruptive as it could make it practical for robots to do welding for low manufacturing run parts. Low manufacturing run parts tend to be made by human welders now.
Very nice. Getting the pairs of wooden pins into the holes for all three cross-pieces of the chair is impressive. That's a tough planning and force-feedback problem.
Ok Bender with Swedish accent assembling my furniture. Best I can imagine my apartment ending up in flames, worst my apartment ending up in black hole just after Futurama jingle.
I wonder if ikea is going to fund this and see it through, offering automated assembly assistance either in-store, or install robot arms in the back of a truck to do it at your house.
IKEA assembly is a trivial task, the fact that it's perceived as otherwise is more an indication of the functional illiteracy and lack of basic mechanical knowledge in the population than anything else. Nevertheless, the fact that IKEA furniture is insanely popular would tend to indicate that many do not find assembly to be overly difficult.
IKEA assembly is trivial for most humans. But that is not the point of the article.
The point of the article is that it is non-trivial for humans to make robots able to do what they can do easily themselves.
The IKEA task was likely chosen because it is something many people have personal experience with, which makes for better public understanding and engagement with the underlying engineering work being displayed.
Not everyone has an engineer mentality. There’s a reason it’s become a meme, some people get honestly stumped by the instructions. Lack tables are easy and so are chairs. I’ve bought some of their larger and more complicated items and would often stare at the instructions cursing.
From what I've seen, it's only tricky for some people because the instructions are shitty - pictures only, low detail, all the parts and fasteners bundled together instead of pre-sorted, etc. A certain amount of trial and error is to be expected.
And if it was that hard you wouldn't see so many people with so much Ikea furniture out there. :)
The robot was "fed a kind of manual, a set of ordered instructions on how the pieces fit together" - if all it was given was pictures of the real manual, that would be quite cool, but I'd love to see more details here.
> Robot Conquers One of the Hardest Human Tasks:
Assembling Ikea Furniture
Totally off-topic but keeps bugging me everytime I stumble upon it: The decades old cliché that Ikea instructions are tough to understand and the assembly will always fail (at first try).
Is this some anti-globalist urban myth?
Has anyone claiming this ever looked at the assembly instruction of furniture of smaller companies? Every mid- to high-class designer furniture item I've bought came with instructions that had terrible UX, that were over-detailed, cramped onto one sheet of paper, had way too small print size to read, made it difficult to differentiate screw sizes etc. virtually all of them left you at one point in uncertainty how to interpret the next step, which could cause destruction if done wrong. Some even came with outright wrong instructions.
Contrast that not only to the text-free Ikea-pictograms that work across the globe, but also to the thought that went into optimizing the assembling so that complicated "points of no return" are virtually absent.
People think that because the visualizations are relatively simple in their shapes, then the design itself must have been simple. It's exceedingly difficult to create instructions that work across language and cultural barriers. It takes a tremendous amount of thought and effort, and IKEA is almost certainly the best in the world and deserve recognition for that.
However, one Ikea product, the formidable “Liatorp” storage unit, which stands at 7-feet tall, has been dubbed “the divorce maker” by one marriage counselor who says the product’s 32-page instruction manual and 169 screws are enough to test even the most solid relationship.
I came here to say this too. Every time I've assembled IKEA I've been been amazed at how well the booklets explain everything without words.
IKEA makes things that just about anyone can assemble, including people who would never try to build any other furniture. Those same people may be the ones propping up the myth because building IKEA furniture is harder than purchasing pre-built stuff from the store.
I personally enjoy putting together IKEA furniture. It's like a mildly easy puzzle with an end result that you'll use every day. It's very satisfying for me.
Admittedly, it's really easy for me to read/interpret the instructions. I could see how assembling furniture would be a challenge if you're not an engineer or something like that.
> Assembling IKEA furniture isn’t hard. People just perceive it to be hard before they even try because it’s a meme.
People have different kinds of capabilities, and IKEA furniture assembly may be easier for developer/engineer-types than others.
The components don't have labels and often require careful inspection to choose the right one, based on illustrations that are also unlabeled and low-resolution. Often times the pieces can be assembled incorrectly in a ways that don't become evident until later, requiring disassembly to correct the mistake. I can easily believe that people who have weaker visual-spacial skills and/or are less detail-oriented would find the assembly hard and frustrating.
Someone made a good analogy elsewhere: assembling Ikea furniture has a lot in common with some kinds of puzzles. Some people love puzzles, others tolerate them, and some hate them. That's not "just a meme."
I remember assembling IKEA furniture, then furniture of another brand (American-made, IIRC). The other brand was at least an order of magnitude harder, even though (or because?) there was copious English text in the instructions.
Between my parents, my wife’s parents, my wife, and I, there are five engineering PhDs. IKEA is fun for us. I’ve been called over to help with IKEA when it looked like the couple was about to get divorced over it.
In my experience it's hard because there are usually a couple of pieces that are kind of broken or don't fit right. I usually have to make a compromise somewhere to finish.
[+] [-] nopinsight|8 years ago|reply
It also explains why no robot is nearly as agile as a mouse, while computers routinely beat human world champions at many ‘complex’ games.
"Moravec's paradox is the discovery by artificial intelligence and robotics researchers that, contrary to traditional assumptions, high-level reasoning requires very little computation, but low-level sensorimotor skills require enormous computational resources. The principle was articulated by Hans Moravec, Rodney Brooks, Marvin Minsky and others in the 1980s. As Moravec writes, "it is comparatively easy to make computers exhibit adult level performance on intelligence tests or playing checkers, and difficult or impossible to give them the skills of a one-year-old when it comes to perception and mobility".
Similarly, Minsky emphasized that the most difficult human skills to reverse engineer are those that are unconscious. "In general, we're least aware of what our minds do best", he wrote, and added "we're more aware of simple processes that don't work well than of complex ones that work flawlessly"."
"As Moravec writes:
Encoded in the large, highly evolved sensory and motor portions of the human brain is a billion years of experience about the nature of the world and how to survive in it. The deliberate process we call reasoning is, I believe, the thinnest veneer of human thought, effective only because it is supported by this much older and much more powerful, though usually unconscious, sensorimotor knowledge. We are all prodigious olympians in perceptual and motor areas, so good that we make the difficult look easy. Abstract thought, though, is a new trick, perhaps less than 100 thousand years old. We have not yet mastered it. It is not all that intrinsically difficult; it just seems so when we do it."
https://en.wikipedia.org/wiki/Moravec%27s_paradox
[+] [-] mtw|8 years ago|reply
[+] [-] jahnu|8 years ago|reply
Does make me wonder where programming fits into this. It seems to be both hard for people and hard for AI.
[+] [-] EGreg|8 years ago|reply
Look at the Cyc project. After decades of work, what have they got?
So I push back on the idea that computers have already been taught what is essentially REASONING.
[+] [-] PhasmaFelis|8 years ago|reply
[+] [-] rimliu|8 years ago|reply
[+] [-] stcredzero|8 years ago|reply
Why isn't teleoperation a more heavily researched area? I suspect that it could be efficiently accomplished with manipulators that are much simpler than human beings or human hands, so long as you add two powerful ingredients:
1) Movable point of view. Basically this could be slaved to the position of a high resolution VR headset. It could even be provided by a tethered drone.
We've had teleoperation for a long time, but it has generally been hampered by a static point of view. What if you could crane your neck and look around what you are doing? This greatly improves the intuitiveness and effective bandwidth of the interface.
2) Haptic feedback.
If you can feel what's happening, even indirectly, it also greatly improves the quality of the interface. Think of the dexterity you have with a pair of forceps or needle nose pliers, versus the dexterity you'd have with those while your hands are numbed by novacaine. Since such mechanisms would be much simpler than a mimic human arm, they'd be much cheaper. Also, human beings are very adaptable to control tasks and don't really require a precise mimic of human limbs. (Witness the amazing feats of backhoe control you can find on YouTube.)
[+] [-] gene-h|8 years ago|reply
Haptics can greatly degrade with lag. There have been some approaches to predict what the operator is going to do or predict that a collision is going to occur and prevent such things, but they have not been able to decrease the time it takes to complete a task[0].
It is worth noting though that remote surgery has been somewhat successful over high bandwidth communication links. One constraining factor for teleoperation research is that there aren't many applications where it makes sense to do so. The problem is that robots and haptic gear are currently expensive which limits the applications. You need an application where humans cannot go or the labor the operator is doing is more valuable than the cost of transporting the operator there and the robot. Applications where humans can't go are fairly niche. In addition, applications like working inside a non-damaged nuclear reactor or subsea operations tend to involve equipment that has been designed to be serviced by the simplest of teleoperated robots. In the case of nuclear reactors, mechanical and hydraulic remote manipulators are suitable for most operations. Very valuable tasks like robot surgery are rarely done remotely, partially because of how expensive surgical robots are. We could put surgical robots in remote locations, but remote locations have less patients to service, so it's hard to justify the cost of putting robots in a bunch of remote locations versus moving the patients to the hospitals.
[0]https://ieeexplore.ieee.org/document/7399376/ [1]https://en.wikipedia.org/wiki/Remote_surgery
[+] [-] gene-h|8 years ago|reply
Now before we can see this approach used in practical applications, they are going to have to improve the reliability of assembling things. If the reliability of manipulating things can be improved, this could be very disruptive. I think that near term, the killer app for this is an autonomous robotic welding cell. In 2012 it was shown that welding work for a vehicle frame could be autonomously planned[0]. Robot manipulation was not good enough at the time, so the robot had to tell the human where to put all the fixtures and pieces to weld and then welded them. The human also had to reorient the parts too. The implication of this work, is that many of the operations they used to make the chair are also applicable to autonomous welding. This could be very disruptive as it could make it practical for robots to do welding for low manufacturing run parts. Low manufacturing run parts tend to be made by human welders now.
[0]https://www.youtube.com/watch?v=2cyq28hoOQ4
[+] [-] Animats|8 years ago|reply
[+] [-] xixixao|8 years ago|reply
Full assembly 8min 55sec.
[+] [-] sbierwagen|8 years ago|reply
[+] [-] Isamu|8 years ago|reply
(I'm thinking of something like Bender with an accent, but hey that's just me.)
[+] [-] ozim|8 years ago|reply
[+] [-] Gracana|8 years ago|reply
https://youtu.be/HowXEBisrkI
[+] [-] Cthulhu_|8 years ago|reply
[+] [-] mlboss|8 years ago|reply
[+] [-] TheOtherHobbes|8 years ago|reply
[+] [-] horsecaptin|8 years ago|reply
[+] [-] wjp3|8 years ago|reply
[+] [-] InclinedPlane|8 years ago|reply
[+] [-] pcrh|8 years ago|reply
The point of the article is that it is non-trivial for humans to make robots able to do what they can do easily themselves.
The IKEA task was likely chosen because it is something many people have personal experience with, which makes for better public understanding and engagement with the underlying engineering work being displayed.
[+] [-] bambax|8 years ago|reply
Mayonnaise is the most popular sauce ever; yet the meme is that it's "disgusting".
Almost everybody has Ikea at home; yet the meme is that it's impossible to assemble.
Maybe memes are trying to tell us something... but I'm not sure what.
[+] [-] analogmemory|8 years ago|reply
[+] [-] majormajor|8 years ago|reply
And if it was that hard you wouldn't see so many people with so much Ikea furniture out there. :)
The robot was "fed a kind of manual, a set of ordered instructions on how the pieces fit together" - if all it was given was pictures of the real manual, that would be quite cool, but I'd love to see more details here.
[+] [-] nkrisc|8 years ago|reply
That is probably not true of most people in the general population.
[+] [-] woodpanel|8 years ago|reply
Totally off-topic but keeps bugging me everytime I stumble upon it: The decades old cliché that Ikea instructions are tough to understand and the assembly will always fail (at first try).
Is this some anti-globalist urban myth?
Has anyone claiming this ever looked at the assembly instruction of furniture of smaller companies? Every mid- to high-class designer furniture item I've bought came with instructions that had terrible UX, that were over-detailed, cramped onto one sheet of paper, had way too small print size to read, made it difficult to differentiate screw sizes etc. virtually all of them left you at one point in uncertainty how to interpret the next step, which could cause destruction if done wrong. Some even came with outright wrong instructions.
Contrast that not only to the text-free Ikea-pictograms that work across the globe, but also to the thought that went into optimizing the assembling so that complicated "points of no return" are virtually absent.
[+] [-] tenaciousDaniel|8 years ago|reply
People think that because the visualizations are relatively simple in their shapes, then the design itself must have been simple. It's exceedingly difficult to create instructions that work across language and cultural barriers. It takes a tremendous amount of thought and effort, and IKEA is almost certainly the best in the world and deserve recognition for that.
[+] [-] wombatpm|8 years ago|reply
However, one Ikea product, the formidable “Liatorp” storage unit, which stands at 7-feet tall, has been dubbed “the divorce maker” by one marriage counselor who says the product’s 32-page instruction manual and 169 screws are enough to test even the most solid relationship.
[+] [-] knodi123|8 years ago|reply
I think both myths comes from the same innocent place - that it's fun to take swings at a big guy who won't get hurt or swing back.
[+] [-] lukas099|8 years ago|reply
IKEA makes things that just about anyone can assemble, including people who would never try to build any other furniture. Those same people may be the ones propping up the myth because building IKEA furniture is harder than purchasing pre-built stuff from the store.
[+] [-] kevindong|8 years ago|reply
Admittedly, it's really easy for me to read/interpret the instructions. I could see how assembling furniture would be a challenge if you're not an engineer or something like that.
[+] [-] ivanhoe|8 years ago|reply
[+] [-] tlarkworthy|8 years ago|reply
[+] [-] giancarlostoro|8 years ago|reply
[+] [-] kazinator|8 years ago|reply
[+] [-] bamboozled|8 years ago|reply
[+] [-] Lionsion|8 years ago|reply
People have different kinds of capabilities, and IKEA furniture assembly may be easier for developer/engineer-types than others.
The components don't have labels and often require careful inspection to choose the right one, based on illustrations that are also unlabeled and low-resolution. Often times the pieces can be assembled incorrectly in a ways that don't become evident until later, requiring disassembly to correct the mistake. I can easily believe that people who have weaker visual-spacial skills and/or are less detail-oriented would find the assembly hard and frustrating.
Someone made a good analogy elsewhere: assembling Ikea furniture has a lot in common with some kinds of puzzles. Some people love puzzles, others tolerate them, and some hate them. That's not "just a meme."
[+] [-] ph0rque|8 years ago|reply
[+] [-] ggg9990|8 years ago|reply
[+] [-] unknown|8 years ago|reply
[deleted]
[+] [-] malvosenior|8 years ago|reply
[+] [-] biggc|8 years ago|reply