Here's a better copy of this classic Richard Feynman address, rendered in text instead of graphics (meaning it can be copied in whole or in part), without any advertising: https://calteches.library.caltech.edu/51/2/CargoCult.htm
This is one of the more influential ideas I've ever come across. Not that the actual behaviour of people living on isolated islands briefly visited in wartime matters so much, but it's a good story. If your take away the concept of
"In trying to emulate success by copying without understanding, you may make the error of copying the visible things, rather than the relevant ones."
then it's a pattern than can be seen in all walks of life, rather than just science (where the difference may be particularly stark). I find that many people will now recognise an accusation of "cargoculting" (although I have heard this interpreted as meaning the worship of a British prince).
I love this article as it speaks to one of the most overlooked aspects of modern life: There are a lot of fundamental things that we take for granted and practice every day - a lot of things with lots of experts and powerful institutions around them - that simply do not work.
And once you have such a thing, and you've build your reputation, your power base, your institution around it, it is absolutely paramount to carry on with it, deepen it, and extend it - regardless of whether it works or not.
But continuing the thing that doesn't work doesn't require some malicious intent or ulterior motive. Quite often, it's just a question of "well, what else would we do?". And the answer to that is often "nothing" - or "we don't know" - so it's better to do something and feel like we have agency and are doing something about it than just carrying on with our lives.
> a lot of things with lots of experts and powerful institutions around them - that simply do not work.
Part of what's going on is that "does not work" is usually a vague moving target.
"Does not work" can be said about any gap between the goal and where we are currently. If you have a system that, on average, closes that gap over time, then the system "does not work" for the entire time it's running. After all there's a still a gap.
Chesterton’s Fence is a kind of inverse impulse to what you're describing. It may be that we think our current systems are nonsensical, but when we change them we realize we've created new problems that the old systems were solving.
And then there's often disagreement about what the goal should be. He mentions decreasing the amount of crime by how we handle criminals. Not everyone agrees that's the goal of the criminal system. Some people very strongly believe that criminals need to be punished or harmed, and those people vote. But punishment and crime reduction are different goals and they may compete. A solution that reduces crime may not harm criminals enough for the blood thirsty voters, and vice versa.
So my reading on all this is that, yes we have gaps in our understandings of a lot of things. But many of those will not be fixed until there's more agreement about what the goals are.
While, as Feynman describes, "Science" absolutely aims to be better, scientists are also human animals and language (or maybe more aptly "imitation") instincts run deep throughout the animal kingdom.
There are pros & cons. On the one hand mistakes like The Cargo Cult propagate. On the other hand, so do skills & shortcuts. There are fine lines between imitating & pretending, practice & pretension. Nature videos show little predator cubs often doing "practice attacks" with siblings... I've no idea what the rate of failing to hold back on a bite is, but presumably the "play" serves most of them well later on in their lives in real hunts.
In short, and very related to Feynman's essay, it's also very easy to fool oneself into thinking one has solved The Demarcation Problem [1] without actually doing so in a way portable/persuadable to other minds. (But Feynman was surely a true genius and would probably have acknowledged the incompleteness of his account in what was after all only a brief graduation speech!)
> You must do the best you can—if you know anything at all wrong, or possibly wrong—to explain it.
I can imagine a frustrated researcher reading this and muttering, "and what? Risk publication?". Scientific integrity, of which Feynman talks is much more difficult to maintain if the said integrity leads to a substantial decrease in the quality of life. As is known, research is a hit or miss and there will never always be groundbreaking results. But if you are only rewarded for such groundbreaking results, you are then incentivized to package the most interesting aspect of your study while burying away the rest of it.
So long as honesty, not success, is not properly incentivized, science and scientific methods will never prosper to the heights that Feynman talks about.
> some kind of mysticism, expanded consciousness, new types of awareness, ESP, and so forth. And I've concluded that it's not a scientific world.
Something being not scientific doesn't imply it doesn't exist. It may instead just be too hard to observe scientifically, sound too crazy and appear uninteresting to scientists. Nowadays there already is enough credible research in these areas to be confident exotic phenomena actually take place in peoples brains when they report mystical experiences - thanks to techniques like fMRI, EEG, transcranial stimulation etc. People may tend to make epic claims and construct wonky ideologies based on what they feel, but they don't always make the entire story up. UFOs also are known to exist AFAIK - there just is no reason to believe that's alien spaceships, that's just flying objects we failed to identify and explain. We just need more real scientific exploration to decrease need in fairly-tale explanations of the phenomena people observe - hasn't this almost always been the case with everything since the stone age? The very fact people try to discuss "supernatural" phenomena with a scientist suggests presence of the demand for more science in this.
In the context of the talk/article, I think its clear that Feynman is critical here of the "fairly[sic]-tale explanations", and not the idea itself.
I've always understood this talk as amounting to "we claim that our society respects science, but our society seems unwilling to apply the rigor that science demands to sort out fact from fiction. See, for instance, all of these erroneous explanations for observed phenomenon, explanations that do not hold up to rigorous examination".
> The first principle is that you must not fool yourself—and you are the easiest person to fool.
This phrase is repeated many, many times in the legendary fan-fiction Harry Potter and the Methods Of Rationality (HPMOR)[1], which I'm sure many here are familiar with already.
It is perplexing to hear people making room for their favourite pseudoscience using the excuse that "there are things science cannot explain". See, the annoying thing about science is that if something can as much as be observed, then it can be observed repeatedly, and then reasoned about - effectively allowing us to do science on it. That's even the case for magic, if it were real, as illustrated in HPMOR.
Even the most absurd and chaotic phenomenon, bereft of any discernible pattern or rhyme or reason, can at least be observed to behave chaotically and then be described as such. Et voilà : science !
And this is what a lot of developers do: copying superficial patterns without understanding. It used to be junior (and not so junior) programmers using unnecessarily complex design patterns without understanding what problems they were about to solve. Then it was building systems out of dozens of services to be able to scale, because they didn't have any idea of what kind of scale they actually needed more than one cpu for.
That's how cargo cults start. They way they are propagated, though (in tech), is when devs become old enough to become "senior" without yet having grasped how and when to use patterns, and then proceed to teach them to juniors as mystical, holy imperatives that must be repeated without questioning.
Plenty of businesses have a life cycle like this:
1. A group of devs strike on some effective patterns through some combination of luck and deep insight.
2. Juniors get hired and are taught the patterns, but not the WHY of the patterns.
3. The founders leave, and the first hires become the leads.
4. The business has now lost the ability to create anything innovative, as everyone are now slaves to the original patterns.
5. Gradually the business loses the ability to recreate even the original patterns, as some details are lost every time they are handed over.
Also included in his memoirs starting with “Surely you must be joking, Mr Feynman!”, well worth reading if you can get over the occasional sexist bits.
[+] [-] lutusp|1 year ago|reply
[+] [-] Y_Y|1 year ago|reply
"In trying to emulate success by copying without understanding, you may make the error of copying the visible things, rather than the relevant ones."
then it's a pattern than can be seen in all walks of life, rather than just science (where the difference may be particularly stark). I find that many people will now recognise an accusation of "cargoculting" (although I have heard this interpreted as meaning the worship of a British prince).
[+] [-] exitb|1 year ago|reply
[+] [-] wolframhempel|1 year ago|reply
And once you have such a thing, and you've build your reputation, your power base, your institution around it, it is absolutely paramount to carry on with it, deepen it, and extend it - regardless of whether it works or not.
But continuing the thing that doesn't work doesn't require some malicious intent or ulterior motive. Quite often, it's just a question of "well, what else would we do?". And the answer to that is often "nothing" - or "we don't know" - so it's better to do something and feel like we have agency and are doing something about it than just carrying on with our lives.
[+] [-] ants_everywhere|1 year ago|reply
Part of what's going on is that "does not work" is usually a vague moving target.
"Does not work" can be said about any gap between the goal and where we are currently. If you have a system that, on average, closes that gap over time, then the system "does not work" for the entire time it's running. After all there's a still a gap.
Chesterton’s Fence is a kind of inverse impulse to what you're describing. It may be that we think our current systems are nonsensical, but when we change them we realize we've created new problems that the old systems were solving.
And then there's often disagreement about what the goal should be. He mentions decreasing the amount of crime by how we handle criminals. Not everyone agrees that's the goal of the criminal system. Some people very strongly believe that criminals need to be punished or harmed, and those people vote. But punishment and crime reduction are different goals and they may compete. A solution that reduces crime may not harm criminals enough for the blood thirsty voters, and vice versa.
So my reading on all this is that, yes we have gaps in our understandings of a lot of things. But many of those will not be fixed until there's more agreement about what the goals are.
[+] [-] wolframhempel|1 year ago|reply
[+] [-] cb321|1 year ago|reply
There are pros & cons. On the one hand mistakes like The Cargo Cult propagate. On the other hand, so do skills & shortcuts. There are fine lines between imitating & pretending, practice & pretension. Nature videos show little predator cubs often doing "practice attacks" with siblings... I've no idea what the rate of failing to hold back on a bite is, but presumably the "play" serves most of them well later on in their lives in real hunts.
In short, and very related to Feynman's essay, it's also very easy to fool oneself into thinking one has solved The Demarcation Problem [1] without actually doing so in a way portable/persuadable to other minds. (But Feynman was surely a true genius and would probably have acknowledged the incompleteness of his account in what was after all only a brief graduation speech!)
[1] https://en.wikipedia.org/wiki/Demarcation_problem
[+] [-] dang|1 year ago|reply
Cargo Cult Science (1974) [pdf] - https://news.ycombinator.com/item?id=37107817 - Aug 2023 (136 comments)
Cargo cult science (1974) - https://news.ycombinator.com/item?id=35041549 - March 2023 (156 comments)
Cargo Cult Science (1974) - https://news.ycombinator.com/item?id=26563567 - March 2021 (69 comments)
Cargo Cult Science (1974) - https://news.ycombinator.com/item?id=21120637 - Sept 2019 (33 comments)
Cargo Cult Science (1974) - https://news.ycombinator.com/item?id=13290107 - Dec 2016 (37 comments)
Cargo Cult Science (1974) - https://news.ycombinator.com/item?id=11669004 - May 2016 (38 comments)
Richard Feynman: Cargo Cult Science (1974) - https://news.ycombinator.com/item?id=6543791 - Oct 2013 (62 comments)
Feynman's Cargo Cult Science - https://news.ycombinator.com/item?id=1629571 - Aug 2010 (25 comments)
Cargo Cult Science by Richard Feynman (.PDF) - https://news.ycombinator.com/item?id=993150 - Dec 2009 (4 comments)
Cargo Cult Science, by Richard Feynman (1974) - https://news.ycombinator.com/item?id=723140 - July 2009 (17 comments)
[+] [-] gwern|1 year ago|reply
[+] [-] pkoird|1 year ago|reply
I can imagine a frustrated researcher reading this and muttering, "and what? Risk publication?". Scientific integrity, of which Feynman talks is much more difficult to maintain if the said integrity leads to a substantial decrease in the quality of life. As is known, research is a hit or miss and there will never always be groundbreaking results. But if you are only rewarded for such groundbreaking results, you are then incentivized to package the most interesting aspect of your study while burying away the rest of it.
So long as honesty, not success, is not properly incentivized, science and scientific methods will never prosper to the heights that Feynman talks about.
[+] [-] foobarian|1 year ago|reply
[+] [-] EricE|1 year ago|reply
[+] [-] swayvil|1 year ago|reply
[+] [-] qwerty456127|1 year ago|reply
Something being not scientific doesn't imply it doesn't exist. It may instead just be too hard to observe scientifically, sound too crazy and appear uninteresting to scientists. Nowadays there already is enough credible research in these areas to be confident exotic phenomena actually take place in peoples brains when they report mystical experiences - thanks to techniques like fMRI, EEG, transcranial stimulation etc. People may tend to make epic claims and construct wonky ideologies based on what they feel, but they don't always make the entire story up. UFOs also are known to exist AFAIK - there just is no reason to believe that's alien spaceships, that's just flying objects we failed to identify and explain. We just need more real scientific exploration to decrease need in fairly-tale explanations of the phenomena people observe - hasn't this almost always been the case with everything since the stone age? The very fact people try to discuss "supernatural" phenomena with a scientist suggests presence of the demand for more science in this.
[+] [-] petsfed|1 year ago|reply
I've always understood this talk as amounting to "we claim that our society respects science, but our society seems unwilling to apply the rigor that science demands to sort out fact from fiction. See, for instance, all of these erroneous explanations for observed phenomenon, explanations that do not hold up to rigorous examination".
[+] [-] tcj_phx|1 year ago|reply
[+] [-] EricE|1 year ago|reply
[+] [-] unknown|1 year ago|reply
[deleted]
[+] [-] boerseth|1 year ago|reply
It is perplexing to hear people making room for their favourite pseudoscience using the excuse that "there are things science cannot explain". See, the annoying thing about science is that if something can as much as be observed, then it can be observed repeatedly, and then reasoned about - effectively allowing us to do science on it. That's even the case for magic, if it were real, as illustrated in HPMOR.
Even the most absurd and chaotic phenomenon, bereft of any discernible pattern or rhyme or reason, can at least be observed to behave chaotically and then be described as such. Et voilà : science !
[1] https://hpmor.com/
[+] [-] seydor|1 year ago|reply
Subscribe to my newsletter
[+] [-] worstspotgain|1 year ago|reply
[+] [-] Ma8ee|1 year ago|reply
[+] [-] trashtester|1 year ago|reply
Plenty of businesses have a life cycle like this:
[+] [-] unknown|1 year ago|reply
[deleted]
[+] [-] superfish|1 year ago|reply
[+] [-] pvg|1 year ago|reply
[+] [-] fmajid|1 year ago|reply
[+] [-] unknown|1 year ago|reply
[deleted]
[+] [-] bazoom42|1 year ago|reply
[deleted]
[+] [-] unknown|1 year ago|reply
[deleted]
[+] [-] nonrandomstring|1 year ago|reply
[deleted]
[+] [-] bumpjammy|1 year ago|reply
[+] [-] unknown|1 year ago|reply
[deleted]