top | item 24794856

(no title)

ianmobbs | 5 years ago

LIDAR maps out the world around you in three dimensions, so with that data, there's no way it would mistake "a 'Stop' sign hidden within a fast food commercial [...] only flashing on-screen for a fraction of a second" (article) for an actual stop sign

discuss

order

jcims|5 years ago

LIDAR can't reliably see signs from far away and definitely can't read them. It's not clear that there would be any usable signal to act on, especially not one of sufficient confidence to ignore a giant red stop sign in the camera.

This isn't a perception issue. It's an insufficient model for the world, and the software is obviously biased towards obeying critical traffic controls at lower confidence levels. It would be interesting to see what would happen if a (higher) speed limit sign was flashed in the same way.

contravariant|5 years ago

Well it probably would stop working if you confuse it with a whole bunch of confetti of reflective material or similar. Although I suppose that would work against humans as well.

Still I wonder if it has failure modes that humans lack, which could result in situations where it does inexplicable things.

ianmobbs|5 years ago

> Still I wonder if it has failure modes that humans lack

Almost certainly :)

brianwawok|5 years ago

But it would fall for a cardboard stop sign on a stick held up by a troublemaker.

dwohnitmok|5 years ago

As would a human given a sufficiently official-looking stop sign. In fact I think it's actually impossible for an automated car or human without figuring out the "troublemaker"'s identity whether the stop sign is fake or not. And it's not always possible to pin down someone's identity (if the person is wearing a brightly colored construction vest what do you do?).

noodlesoups|5 years ago

That requires a whole different kind of effort. These hacks can be done remotely from the other side of the world and leave little trace