[joebob42]

Sure, but I imagine at least some components only really execute a small number of times per flight, or possibly never in the case of certain error handling code. Stretching the metaphor more than is probably appropriate, I'd treat launching the shuttle and having it come back as a big integration test. A system that passes it's integration test 100 times isn't necessarily particularly impressive in terms of reliability.

We run our integration test tens of times a day, and it fails once or twice a month. Our system is kinda flaky :(

[rco8786]

> A system that passes it's integration test 100 times isn't necessarily particularly impressive in terms of reliability.

So extending your own metaphor and using 100 as the number of missions, the integration test failed 2% of the time.

[joebob42]

A 2% failure rate isn't impressive, but I'm fine not crediting any of the shuttle issues to software. My only point is that 100 instance of use for purpose isn't enough, to my mind, to argue that a piece of software is exceptionally reliable.