Waymo issues software and mapping recall after robotaxi crashes into a pole

[mehlmao]

If self-driving vehicles are tested on public streets, all data generated should be public. Companies should be cooperating, not competing, on "don't hit telephone poles" and "don't run over children".

[arijun]

Sounds cool in theory, but much less than useful in practice. The hardware and file formats are different enough that the data would be mostly useless to us (I work at a self driving-ish company).

The models are predicated a specific set of hardware ( which camera, what fidelity LiDAR, but even something as simple as “what’s the frame rate” can have a difference)

[patmorgan23]

Should all Google Street view data be publicly available?

[LeifCarrotson]

After some sleuthing and Geoguessring, here's the alley where it happened:

https://maps.app.goo.gl/UNUzQn686ESYWbfo7

Further south of the pin, by the section of the alley with stripes on the pavement behind the garages for 842 N 6th Ave (but not on 6th or 7th, on an unnamed alley between the two).

Let me repeat - it's an alley. The Google Maps car didn't even go down that road (though it looks to have been under construction when the Maps car went through).

Without exclusing Waymo (they had their car do something dangerous and stupid) this is the kind of pseudo-off-road parking lot/driveway/construction zone nav stuff that's really hard to get right, and almost requires AGI.

I think the real error was not the damage score but the planning algorithm that directed it to drive down and to continue through that alley.

I think we'll soon get to (if we're not there already) a form of level 2 driver aids or level 3 geofenced self driving (highway only?) that's safer than average human drivers. I think we're a long way from self-driving cars that will assign a low damage score and drive over an empty cardboard box in an unmarked, unmapped private alley, and we may never get there. But that doesn't mean Waymo can't or shouldn't exist, it means they need to shut down the car and delegate to a human when they're stuck and not not on public, mapped, confirmed clear roads. Maybe that means it can't pick you up from the back of the Chic Fil A parking lot or the entrance to the mall that's an island in a quarter mile of private parking lots and you have to go to the nearest parking spot on the actual road, but if the alternative is assigning damage scores to stuff in alleys that's probably for the best.

[rvnx]

I'm sure they did it out of caution, considering their excellent track record. Love this company, would like to see them expanding.

[hn_throwaway_99]

I'm interested about the legal requirements of Waymo filing a recall notice with the NHTSA. That is, all the affected cars were actually owned by Waymo - could they have just updated the cars anyway, by themselves.

To emphasize, I'm genuinely curious. I don't understand how the recall notice process works if your product isn't owned by anyone else but you.

[LanceJones]

I don't think the economics will work (for quite some time). They have ~670 cars in total, and still have seriously negative cash flow.

[bastawhiz]

This is the most interesting part, in my opinion:

> Waymo’s recall was deployed by the company’s engineers at the central depot where the vehicles return for regular maintenance and testing. It was not through an over-the-air software update, like some of Tesla’s recent recalls.

I'd be interested to learn more about why the updates are manual, and also whether the map data is fully local to the vehicle. Tesla obviously does the polar opposite of this, and it seems to have at least some degree of success, but Tesla's approach has always seemed like it would be subject to some bad potential failure modes in my mind.

How much data does this amount to? Gigs? Terabytes?

On the same note, I'm curious about what data gets pulled from the map versus sensor data. The car seems to have used map data instead of sensor data (unless I'm misunderstanding?). Whether there's a curb seems to be exactly the sort of thing you could rely on sensors for, mostly because you also already need to look for obstructions which necessarily can't be in map data.

[xnx]

It's a shame there are so many trade secrets involved, because it would be especially fascinating to get more details on their entire system everything from advanced topics like how they blend ML with traditional rule-based logic to how they manage data like maps (versioning, distributed updates, etc.)

[unshavedyak]

Maybe it's about validation, not necessarily update data. They do seem to take safety more serious than Tesla does.

[AlotOfReading]

It sounds weird to say, but updates being applied only in-garage doesn't mean they're not going over the air. However, updates can include software for between dozens and hundreds of individual processors. That makes them quite large. The real data pigs are driving logs and map data though, which are usually serious storage constraints in autonomous vehicles.

[choppaface]

Could be a lidar failure, or potential failure, that needed a firmware update to address.

[Animats]

"The update corrects an error in the software that “assigned a low damage score” to the telephone pole."

What did it get classified as? What's a Waymo allowed to hit?

[mucle6]

My best guess is they're lying, or they model curbs to have a "low damage score" so its okay if the ai thinks theres a 10% chance a path will hit a curb.

I'm excited for self driving cars, but I have reservations about a system that has to hard code "don't hit a telephone pole". It reminds me of this skit https://www.youtube.com/watch?v=3m5qxZm_JqM

[AlotOfReading]

Cars hit "objects" all the time without issue. Bits of paper flying through the air, bags, cups, steam clouds, and other small objects are very common sources of "motion planning collision" in urban environments.

[choppaface]

In lidar it could have looked like a tall traffic cone or a one of those skinny flexible posts that line the boundaries of some bike lanes. Those things cause much less damage. Telephone poles are obviously much thicker but in lidar space the two can look more similar especially if the cloud is very sparse or the sensor is broken.

[dpig_]

I kind of love the idea that Waymo sees the world as an RPG, and that mundane objects have damage statistics. I hope Tesla knows I do poision damage.

[gowld]

The robocar "trolley problem" appears to be real.

[wmf]

I assume Waymo is continuously improving the safety of their software. It's bizarre to classify two of these updates as "recalls" but not the others.

[webwielder2]

"Recall" really needs to be retired as a term.

[nickff]

It’s a term of art; as such, it’s probably here to stay.

[TacticalCoder]

What'd be the proper term then? In french when, for example, many cars are sent back to the dealerships (or factory) to fix something, it's called a "campagne de rappel ("recall campaign").

P.S: I've got nothing against "recall" being recalled so that it can be fixed ; )