top | item 7731320

Air traffic system failure caused by computer memory shortage

65 points| hudibras | 12 years ago |reuters.com | reply

44 comments

order
[+] damian2000|12 years ago|reply
Sounds more like a bug rather than a lack of memory to me ...

The flight plan did not contain an altitude for the flight, one of the sources said. While a controller entered the usual altitude for a U-2 plane - about 60,000 feet - the system began to consider all altitudes between ground level and infinity.

The conflict generated error messages and caused the system to begin cycling through restarts.

[+] hudibras|12 years ago|reply
They didn't have enough memory to cope with an infinite number of inputs.

Obviously a hardware problem...

[+] tomp|12 years ago|reply

  unsigned short int altitude;
[+] ape4|12 years ago|reply
Maybe it attempted to allocate a huge structure for each foot of altitude.
[+] vince_refiti|12 years ago|reply
This scenario wasn't unit/functional tested then.
[+] MattHeard|12 years ago|reply
It sounds like the altitude existence assumption caused cascading errors which in turn exhausted the system memory.
[+] colanderman|12 years ago|reply
A perfect example of why embedded or safety-critical systems should never dynamically allocate memory from a common pool.

Such systems should always preallocate fixed-size heapsfor each subsystem, each of which can then dynamically parcel out pieces of their own heaps if necessary. This helps limits the damage of any memory leaks in the system.

[+] atlantic|12 years ago|reply
So much talk about Snowden, and then a newspaper reveals how to trigger a software bug than can shut down the entire air traffic control system for a large segment of the US. This is a genuinely damaging revelation, even if some critical details are lacking. Curious that the government is not up in arms about it.
[+] awjr|12 years ago|reply
Having worked on ATC, this really does sound like a software bug. Fixing such a bug on a delivered system would require an immense amount of costly testing. Adding memory is the cheap option.

The other thing to consider is that some of these systems are rather old and could easily have less than a gig of ram.

[+] andreasvc|12 years ago|reply
That sounds very worrying. The fact that this issue occurs shows that they didn't prepare for OOM conditions, and another issue could easily cause a different OOM condition they didn't prepare for. It's not inconceivable that there could be an issue which gobbles up an amount of memory you throw at it. It is a tragic irony that the fact that testing is costly may be the very reason this condition was not tested for.
[+] lyndonh|12 years ago|reply
> Adding memory is the cheap option

Only in the sense of having a broken system, putting in place some procedural constraints and then praying that everyone follows the rules.

As you say, it's a software bug. Until it's been 100% characterised and tested this leaves a huge question mark hanging over the system. Adding memory is a band aid solution.

[+] strictfp|12 years ago|reply
Lack of constraint leads to infinite search space. Sounds like constraint programming.
[+] kijin|12 years ago|reply
said Dan Kaminsky, co-founder of the White Ops security firm and an expert in attacks based on over-filling areas of computer memory.

That sounds more like buffer overrun than OOM. One is a Heartbleed-class vulnerability, the other is a pretty straightforward DoS situation. But of course why would we expect Reuters to be able to distinguish between the two...

[+] andreasvc|12 years ago|reply
That's irrelevant to the rest of the article, it's only how his expertise is characterized.
[+] huhtenberg|12 years ago|reply
I would guess that it was some form of an numeric overflow, signed/unsigned issue or out of bound array access, because the only abnormal thing here is U2's altitude.
[+] andreasvc|12 years ago|reply
Have you read the article? The cause is explained quite explicitly, and it was the very absence of the altitude not any of the things you mention.
[+] jmnicolas|12 years ago|reply
What's the point of flying the most stealthy plane on earth if you have to register a flight plan ?

I thought such a plane would be 100% autonomous and be able to "see" and avoid other planes.

[+] ars|12 years ago|reply
> flying the most stealthy plane

A U2 is not at all stealthy. You must be thinking of some other plane.

> if you have to register a flight plan

It's not a military operation in a foreign country, it's a routine flight in the home country.

> I thought such a plane would be 100% autonomous

The U2 was made long before such computers existed. They do have drones now.

> and be able to "see" and avoid other planes.

It wasn't the plane with the problem, it was ground control.

This must be a world record: A faulty assumption in every single sentence!

[+] andreasvc|12 years ago|reply
It's not the most stealthy plane on earth, in fact it has been shot down over the Soviet Union and China in historical cases, because of being tracked by radar. Moreover it was flying over American airspace, it makes sense to register it.
[+] venomsnake|12 years ago|reply
A good idea when you consider that it could be mistaken for some bad guys plane, shot down and probably cause WWIII (not that long shot - the US and USSR were at a few times very close to annihilation due to glitches in their own software)