top | item 23367455

The Trolley Problem Problem

77 points| Hooke | 5 years ago |aeon.co

115 comments

order
[+] dereferenceddev|5 years ago|reply
There just seems to be a misunderstanding on the intention of a though experiment here. There is a subtle implication that because the thought experiment is "contrived" that its less valuable.

When thinking about philosophy, a core part of philosophy is to reduce concepts, ideas, or beliefs into abstractions (or a "spirit" or "essence" of what their intention is), the thought experiment presents itself as a perfectly useful tool to help challenge those concepts.

Ethics is not about absolutes, but really about sussing out where gray areas exist in what some might believe are black and white situations. Additionally, most of the scenarios are presented as a thought experiment, because conducting a real experiment with those conditions would be wildly _un_ethical.

How are we supposed to determine the nuance of valuing human life if we were bound to doing actual experiments? Also, who in their right mind would conduct such as experiment?

Zimbardo faced enough flack testing the limits of obedience and authority in the Standford Prison Experiement.

[+] stupidcar|5 years ago|reply
Why does every comment like this, criticising an article, always claim the author doesn't understand the concept they're talking about? You can just disagree with something without using cheap tactics like this to imply the author is ignorant.

I see no evidence of this claimed misunderstanding in the linked article. And there's nothing "subtle" about it saying thought experiments lack value because they're contrived, that is the central point its making.

[+] keithnz|5 years ago|reply
As I see it, it's just a tool to try an unravel principles. They aren't trying to solve specific situations. Thought experiments often have counter thought experiments, like with the trolley problem, if pulling the lever seems more ethical, when you have 4 patients who will die without an organ transplant, and you have 1 patient who is healthy and organs could be harvested to save 4. It starts becoming harder to work out what the critical principles are. Just like in the article of the killing vs letting die, the assassin example is an alternative thought experiment. This is more important if you have to encode these things in laws / policy where you need a more generic guide to what is acceptable. But you wouldn't rely just on thought experiments to do this, they are just tools to help shake the "thought tree" to see what falls out.
[+] JoeAltmaier|5 years ago|reply
Taking ethics out of context, squashes the very life out of it. The related context is the whole ball game. Further, pretending one thing is like another (adult violinist dependent on your kidney; foetus dependent upon mother) erases several critical ethical points in an obvious attempt to argue toward a conclusion. Its disingenuous.

A simpler example: Killing a convicted murderer, is murder again! Oh, except the murderer has a whole different ethical context than say a child: the murderer is again a threat to more people; the murderer had agency and could have decided not to murder; the act has societal benefit instead of harm; and on and on.

And if you don't like my argument, then voila! Taking your ethical dilemma and recasting it as mine seems "not fair!" to you. Which ironically is my point and QED.

[+] paganel|5 years ago|reply
> philosophy is to reduce concepts, ideas, or beliefs into abstractions

This in itself can be see as problematic, as one can say that trying to reduce "concepts, ideas, or beliefs into abstractions" is futile, as those "things" are not black and white, they do not conform to Aristotelian logic of one thing/concept being either "true" of "false", there's a "continuum" (for lack of a better word) when trying to define each and everyone of those terms.

In other words one cannot be moral or not-moral (to go back to the trolley problem), there's a moral "continuum" which even varies with time (I know I'm less "moral" before I had the chance to drink my coffee early in the morning).

[+] klmadfejno|5 years ago|reply
I agree, but also disagree, because many people take this as a literal problem. People think "how can we have self driving cars until they can solve the trolley problem in a way I find agreeable?" but that's not really how the world works. Just try not to hit people. And not just practically in the sense that literal trolley problems never occur. If you find yourself in a situation of needing to choose the lessor of two evils, you're probably just best off believing that absolute morality doesn't exist and you're just going off your gut because that's how you, as an individual human, work.
[+] michaelt|5 years ago|reply
I don't think the author's objection is to thought experiments in principle but rather, to the way they are composed and used.

After all, a thought experiment that only holds true given an impossible premise would have no rhetorical power if we weren't willing to extrapolate our conclusions beyond the premise, to the possible. Which we are - that's why the trolley problem is taught to people who aren't railway signalmen.

There's a risk there are arguments we think are convincing us because they have isolated a pure abstraction - but actually it's the false dilemma in the premise that convinced us, while the argument distracted us.

[+] mc32|5 years ago|reply
Instead of conceptual people you could experiment with real fish or chickens.
[+] contravariant|5 years ago|reply
That said the experiment does deny the always precent uncertainty (or hope, depends how you call it). Arguably the most ethical course of action would be to do everything to prevent any deaths. This might be futile, but it's impossible to know at the time.
[+] viburnum|5 years ago|reply
It’s not just philosophy. So much of economics education is getting students to narrow their vision down to the something that somebody else wants them to see. Force the assumptions on people and then tell them how smart they are when they draw the inevitable conclusions. It’s a trap. Normal people forget about the assumptions and walk away believing the conclusions. It’s a technique for reshaping people’s intuitions.
[+] 6510|5 years ago|reply
haha, yes! Why is everyone relevant in philosophy dead?

The answer to the trolley problem is that it doesn't matter if you pull the lever or not. You should figure out who or what created the situation and truly eliminate the problem at its source.

[+] castratikron|5 years ago|reply
Stallman said it better:

The Trolley Problem poses this question: if a trolley is about to run over and kill five people standing on the tracks, and you can shunt it to a different track where it would only kill one person, should you do it? Or what if you could save those five by throwing a person near you onto the tracks; should you do it?

Many people feel intuitively that it would be wrong to throw that person onto the tracks, and an argument attributes this to a supposed essential difference between killing someone and deciding to let that person die.

I disagree. I too believe it would be wrong to throw that person onto the tracks, in real life, but not in the hypothetical trolley problems. There is no ethically significant difference between killing a person and letting the person die, if (as supposed in the trolley problems) there is no doubt that the death will occur.

The reason, in real life, why killing someone is ethically different from letting someone die is that real life is full of surprises: the person might not really die. If you kill him, his death is pretty certain (though not totally; just recently a man was hanged in Iran and survived). If you merely don't take action to save him, he might survive anyway. He might jump off the track, for instance, or someone might pull him off. All sorts of things might happen. Likewise, throwing the one person onto the track might not succeed in saving the other five; how could you possibly be sure it would? You might find that you had done nothing but cause one additional death. Thus, in real life it is a good principle to avoid actively killing someone now, even if that might result in other deaths later.

The trolley problems invalidate the principle because of the unlikely certainty that they assume. Precisely for that reason, they are not a useful moral guide for most real situations. In general, difficult artificial moral conundrums are not very useful guides for real-life conduct. It's much more useful to think about real situations. In the free software movement I have often decided not to propose an answer to a general question until I had some real cases to think about.

For real driverless cars, the trolley problem never arises: the right thing to do, whenever there is a danger of collision, is to brake as fast as possible.

More generally, the goal is to make sure to avoid any trolley problem.

https://stallman.org/articles/trolley-problem.html

[+] TheRealDunkirk|5 years ago|reply
> The trolley problems invalidate the principle because of the unlikely certainty that they assume.

We're living the trolley problem problem in real life, right now, because human beings are bad at estimating risk. A lot of people are operating with a certainty that IF you are EXPOSED to the virus, you WILL contract it, and it WILL be terrible, and PROBABLY fatal. Therefore, no amount of safekeeping -- masks, distancing, wiping down delivered groceries, baking mail and newspapers -- can be too aggressive. For such people, diverting the "trolley" to make long-running, terrible financial hardships for a third of the population is an easy call, when they feel they are literally saving the life of everyone on forward track.

[+] bigfoot675|5 years ago|reply
> the right thing to do, whenever there is a danger of collision, is to brake as fast as possible.

This actually isn't true in every scenario. What if there is a car following close behind? What if the car behind has more passengers than the car in front of you? What if swerving will kill pedestrians, but less than the passengers in the car you're about to hit?

There are a lot of variables, and it's really not as straightforward as you make it sound

[+] DangitBobby|5 years ago|reply
I was in just such a conversation the other day, where we were discussing the implications of the second amendment with regards to tyranny in the US. A participant would not allow the conversation to continue without a description of how tryanny would take hold, and no hypothetical was realistic enough. They could not have brought the conversation to a halt faster if it were deliberate. Ultimately, they didn't agree with the point (which was sound) because they believe that our "democracy" is sufficient to prevent tyranny now and forever.

The point of discussions about scenarios whose parameters cannot be known is to find a useful way to elide the unknowns and come to conclusions that we can agree to and understand. Failing to see the forest for the trees is not a problem with the exercise; it's a problem with the participant.

[+] Traster|5 years ago|reply
The problem is that there's nothing inherent about a hypothetical that elides irrelevant details, it elides only whatever the author of the hypothetical wants to elide. Hypotheticals can let us agree on one aspect of a situation, but it can't make us agree on how relevant that aspect is to the situation we're actually interested in. This is why the trolley problem as applied to autonomous driving is so problematic, whilst it's an interesting thought experiment, its totally irrelevant to the person actually designing a self-driving car. It's a perfectly valid position to take that a situation is complex enough that hypotheticals aren't ever going to be helpful in reasoning about it.
[+] mjevans|5 years ago|reply
It is sad that I am far more willing to believe those events plausible. There is a saying about attributing to stupidity before malice, and I think that also applies to the foundation of how such an outcome could occur.
[+] efitz|5 years ago|reply
One challenge that I have always had with the trolley problem is that in general solutions are not symmetrical. By this, I mean that as an observer, I might conclude that several different choices made by the subject of the experiment were ethical. For instance, if the subject threw the switch and caused one person to be killed (instead of multiple), I would see that as ethical. I would also see it as ethical if the subject did nothing, either out of shock or out of refusal to actively participate in anyone’s death. So I guess the problem is that I’m not convinced that the thought experiment generates objectively ethical outcomes, only subjective ones.
[+] luckylion|5 years ago|reply
> So I guess the problem is that I’m not convinced that the thought experiment generates objectively ethical outcomes, only subjective ones.

But that's also literally what it's supposed to do. It's a device to poke around and figure out your positions, e.g. are you into consequentialism or do you prefer deontology, are there circumstances that can change your position etc.

I often find people (not you, people in general) rejecting thought experiments, because they are not comfortable with their intuitive decisions and they feel that it will be exposed when they're forced to apply it to a hypothetical situation that does not leave them an easy out ("this wouldn't happen, I don't walk near train tracks, ever").

[+] sukilot|5 years ago|reply
Absolutely bizarre to see a philosopher writing at some length that some questions are bad because they are hard to answer cleanly. Does he know what his profession is?

It's also poor form to sling broad accusations about what "some" philosophers do without citing any examples.

[+] logicchains|5 years ago|reply
>Absolutely bizarre to see a philosopher writing at some length that some questions are bad because they are hard to answer cleanly.

It's hardly bizarre. Wittgenstein, one of the most famous philosophers of the 20th century, wrote that most philosophy was incorrect because philosophers failed to clearly define their terms.

"The right method of philosophy would be this. To say nothing except what can be said, i.e. the propositions of natural science, i.e. something that has nothing to do with philosophy: and then always, when someone else wished to say something metaphysical, to demonstrate to him that he had given no meaning to certain signs in his propositions. This method would be unsatisfying to the other — he would not have the feeling that we were teaching him philosophy — but it would be the only strictly correct method".

[+] bigfoot675|5 years ago|reply
I would think it worse to operate under the "principles of his profession" without questioning them at all, no?
[+] mc32|5 years ago|reply
Why? Why is questioning presumptions bad? If the accusations end or weak then it proves philosophy still has it right. On the other hand it could cause a rethinking and perhaps fine some merit in the criticism,
[+] imtringued|5 years ago|reply
I dislike these types of thought experiments because they always involve a preexisting problem where a random bystander has to become a hero that has to save everyone. There are a lot of situations in which fate is just playing out and you can't do anything about it and struggling will only make everything worse. In reality, the hero doesn't actually know which lever will actually save lives and he also doesn't know if the people he is saving are actually in danger.
[+] smitty1e|5 years ago|reply
TTPP seems to be suspension of disbelief.

If the audience cannot enter into the problem, then its value as a tool is diminished.

Case studies are also fraught with peril, but the analysis of where the particulars end and the general principles begin seems the bulk of the exercise anyway.

[+] Natsu|5 years ago|reply
More than that, they reduce too much of the problem away. It reminds me of the two capacitor paradox [1] which (spoiler alert) only arises because that configuration isn't actually possible to realize in terms of ideal circuit elements.

In particular, we spend a lot of time thinking about what would have to be, in most formulations of the problem, a quickly-decided act (otherwise, why not simply untie the people?) and we have absolute certainty given us as to the consequences, vs. all the uncertainty in real life. The problem is used to get rid of those elements as distractions, but they're essential features of people's reasoning (and reasoning ability) so they're not so easily discarded.

[1] https://en.wikipedia.org/wiki/Two_capacitor_paradox

[+] Sophistifunk|5 years ago|reply
The trolley problem is a non-problem. I don't know about you guys, but nobody I know is ever going to buy a car that might decide to kill them to save some stranger(s).
[+] throwaway2048|5 years ago|reply
The trolley problem in regards to autonomous cars is a total sideshow when the cars we do have cant reliably tell people from bicycles from other cars.

Its often used as a sort of backdoor to squeeze in the argument that we should let X people die to autonomous cars because in the future they will definitely be safer, for sure. (some very shaky priors there)

These arguments are usually introduced with massive assumptions about the applicability and reliability of statistics gathered from cars that basically give up when even slightly challenged with anything remotely ambiguous or difficult (how many people live where there is perfect weather almost every day?), and then are applied to the entire gambit of circumstances human drivers deal with every day, by the millions.

[+] dannykwells|5 years ago|reply
Could this be due to the rise of pure mathematics in influencing philosophers? In pure math, counter examples play a very important role: show once counter example, disprove an entire claim.

The violinist in the article is clearly trying to be a pure math- like counter example, but to me, misses the emotional aspect of pregnancy (at the least) - a fetus is not a random person, it is you (partly), and furthermore, many would say society (and the species) depend on having babies, whereas the society and the species do not depend on violin players.

Not saying I agree with these arguments only that the real world is substantially messier than pure math, and thus, pure math thinking may stumble when applied to real world problems.

Tl;dr: humans are not rational in our beliefs and the continued attempts on all disciplines to assume we are, are well, irrational.

[+] dereferenceddev|5 years ago|reply
I've rarely heard someone make the counter-point that a fetus is technically half "you", which really does fundamentally change the violinist example.

The violinist experiment does have a lot of holes it it, but I think that one in particular almost turns it on its head, particularly because it circumvents the crux of the problem around consent (which I think is at the core of the problem).

It would seem you would have to change the thought experiment to have the violinist actually be related to you (say a sibling). Now, would a person feel _as_ upset that they had to allow their sibling to use their kidneys for nine months in order to stay alive? That really changes it.

[+] implements|5 years ago|reply
> society [...] depend on having babies,

But civilisation doesn’t depend on maximising births, and actually probably would benefit from more resource intensive to produce artists, musicians, dancers, etc - is the other side of that argument.

[+] kwhitefoot|5 years ago|reply
> Had the context been one in which a hitman was preparing to take a hidden shot at a target, and the target then died of a sudden cardiac arrest as the hitman remained out of sight, it’s far from clear that killing and letting die would be equally bad.

But the two situations are not equivalent. The hitman is almost certainly not in a position to save his intended victim so he is not in any meaningful sense letting him die.

[+] brodouevencode|5 years ago|reply
[+] NoPicklez|5 years ago|reply
I think its a silly response to the problem, yes if you were near the lever and you so happened to know one of the groups then you might argue pulling the lever one way or the other.

But is that simply you justifying your actions?

The problem isn't absurd when posed to humans because, how about the scenario where you don't know either person and you need to make a decision in a matter of seconds. That's the point.

If my mother was on one of the tracks, I might justify my actions to pull the lever and have it veer into the other group, but that isn't necessarily a morally correct decision.

The author in the article says that the problem is absurd when posed to humans, then goes onto applying the same principles of the problem to AI and cars but does not say that the problem is also absurd with regards to AI, despite coming to the same conclusion.

[+] mindtricks|5 years ago|reply
The trolley problem came up a lot in The Good Place, which may be why discussions around it have suddenly become a bit more mainstream.
[+] post_below|5 years ago|reply
Maybe a little off topic...

Ethics thought experiments are interesting and sometimes fun and you can't deny the value of getting people thinking about choices and behavior.

But it's always seemed to me that they, along with ethics in general, miss the point. I don't think absolute right and wrong, or even absolute "lesser of two evils" is a particularly useful goal.

It's the contextual framework that matters... Values, priorities, fears, desires, needs, the things that comprise a person's identity and worldview. Those things are going to win over ethics every time when real world decisions are being made.

IMO there's a lot more value in exploring those things, as opposed to ethics, if the ultimate goal is to impact the behavior of a individuals in a society.

[+] adjkant|5 years ago|reply
The irony here is you just pigeonholed "ethics" and then made several ethical arguments yourself while saying you don't care about ethics!

To add some formal language:

> I don't think absolute right and wrong, or even absolute "lesser of two evils" is a particularly useful goal.

This sounds like a metaethical argument - what underpins ethics is a very important question that a lot of people miss, but that argument is actually the base of ethical stances. The formal metaethical belief here is objectivism. Some other options are things like subjectivism, cultural relativism, error theory, and non-cognitivism.[1]

[1] A video alternative: https://www.youtube.com/watch?v=FOoffXFpAlU

> It's the contextual framework that matters... Values, priorities, fears, desires, needs, the things that comprise a person's identity and worldview. Those things are going to win over ethics every time when real world decisions are being made.

Ethics (once you get past metaethics) is almost always around a framework, and focuses exactly on everything you listed. Aristotle explicitly focused on values to built his ethical framework. Foucault talks a lot about fear and power. Most of consequentialism and utilitarianism focuses on needs and desires. Rawls and egalitarianism is an example of talking about priorities.

--------------------------------------------------

To me, it sounds like you have a gripe with the impracticality of philosophers talking about ethics but care quite a lot about ethics itself. If so, I'd be with you strongly on both accounts.

[+] luckylion|5 years ago|reply
> Those things are going to win over ethics every time when real world decisions are being made.

And the point of the thought experiment is to uncover those things, and they make up that person's personal ethics. Maybe their ethics are "I'll always save my family, fuck everybody else", maybe their ethics are "I only save people who share my skin color", or maybe they are "I always maximize the damage, I hate people", using hypothetical situations allows you to figure that out without taking that person on daily walks and sacrificing lots of people on the train tracks to find out.

[+] msla|5 years ago|reply
The problem here is reminiscent of the classic short story "The Cold Equations": A young woman is fooling around near a space ship and ends up accidentally stowing away on a craft needed to move serum to a colony in the grips of disease. The mass on the ship is accounted for to the gram (the gramme, even!) so her excess mass means the ship no longer has the fuel to make it to the colony. The dashing space hero has to jettison the innocent young woman in order to save untold numbers of people.

OK, what's blindly, blisteringly wrong here? First, the idea that a space ship small enough its fuel would be rationed out by the gram would have enough room in the crew compartment for someone to hide in is ludicrous. Second, launching without a checklist? Are you out of your tiny little mind? Third, allowing unknown people to bring unknown contaminants into a space ship? Having a "KEEP OUT" sign doesn't save the colonists from another plague, now, does it?

The moral of the story is that it's hard to keep your mind on the supposed lesson when the flaws jump up and down and yell at you.

Taking a different tack, by thinking too hard about the consequences of the thought experiment instead of the lead-up to it, there's the Jew in the attic. You know how it goes: A Jewish family is hidden in your attic or guest bedroom or someplace and the Nazis come knocking. Do you lie to save the Jews? "Of course", you say, and come up with a nice logical argument for why your ethical system demands you lie in this instance. All functional ethical systems can come up with such an argument with minimal fuss. However: The Nazis were not very nice, you know. If they thought a town was holding out on them, they'd initiate reprisals. They'd kill a whole town in a fit of fascist pique. Saving a half-dozen Jews could doom a few thousand innocents, likely including the original Jews. But that's out of scope for the thought experiment.

[+] wccrawford|5 years ago|reply
SpaceX just launched a shuttle into orbit that had a 1 second window for launch. They had zero extra fuel on board. It had 2 passengers and room for 2 more.

It's not ridiculous at all to think that they'd fuel a supply ship with exactly the fuel it needed and not more, and that that supply ship might have some empty space in it, especially if it were very, very large.

[+] perl4ever|5 years ago|reply
That's a famous story I've heard of, not sure if I ever read it...but I feel like it could be compared and contrasted with "The Only Neat Thing To Do", kind of a different take on a young woman looking for adventure who ends up paying the ultimate price for the good of humanity.

Edit: Haha, I clicked on a link to goodreads and the second comment compares it to "The Cold Equations".

[+] mjevans|5 years ago|reply
Also out of the scope of the experiment... The rocket in question is already doomed due to the lack of any safety envelope at all.

The mass included in the initial acceleration has already been accelerated, so even if they space someone it's not making it to the destination.

Also; How would they eject someone into space without going off course or using more fuel?

[+] arkades|5 years ago|reply
> They'd kill a whole town in a fit of fascist pique.

That's a new one to me. Any sources I can read up on that?

[+] sukilot|5 years ago|reply
You reject science fiction for being too unrealistic in its imperfect space travel engineering, meanwhile NASA blew up two crewed Space Shuttles by launching shuttles that they knew had failed components.
[+] SpicyLemonZest|5 years ago|reply
I'm stunned that this article was published just a few days ago, because recent events have illustrated just why it can be important to think about strange, unrealistic hypotheticals. How much easier would lockdown debates have been, if we had the conceptual frameworks in place to talk frankly about how many lives must be saved to justify suspending certain freedoms?
[+] sukilot|5 years ago|reply
How does that help.

"By my weightings, freedom is more important than public health."

"My weightings say the opposite."

That's where we are today. Putting numbers on it, numbers that can't be determined except by our personal biases, doesn't help.

Here's a fun story about cost benefit analysis in the real world, a bureaucrat deciding which kinds of rape hurt enough to be worth preventing:

Criticism: https://gulcfac.typepad.com/georgetown_university_law/

Defense: https://www.theregreview.org/2013/09/13/13-sunstein-cost-ben...

[+] downerending|5 years ago|reply
I've been thinking about the Trolley Problem these days as well. It's not just "How many lives must be saved to justify suspending certain freedoms?". More importantly, it's "How many lives must be forfeit to save someone from dying of COVID-19?". Based on the collateral damage estimates I'm seeing, we might be forfeiting five or ten for each save. And if one switches to quality-life-years as a measure, the picture might be even worse.

Anyway, long live the Trolley Problem.