I found the giant line graph problematic because of the hand waving they did to normalize when the breaks occurred during the day. It also disturbs me to see such large, high frequency variation in a line that is averaging a large number of events without explanation.
The dataset certainly begs for a better analysis. For instance, from the supporting material, is there really a judge (the 'X' marker) the never granted parole to the last three people before his morning snack, but granted 70% for the first three of the day on average? All year, for a significant number of cases? Did no one notice that the people before snack time were not getting due process?
No, that graph is incredible. Literally unbelievable. 70% accepted in the morning to down below 10% before snack? Either this data is BS or there's some hidden variable here.
The comments on the original article do suggest another variable. The schedule may not be randomly arranged. The judges or the court clerks could actively arrange for easy cases earlier and more diffficult or complicated cases later. IOW, the variables may not be independent.
Also it's worth pointing out that this was a study on Israeli judges. American legal precedents and opinions and scheduling norms may not apply.
This is true and obvious to some extent, but there's some real downsides to the legal realism movement. Legal realism starts off with a correct premise - that judges are flawed and human like the rest of us - but some people go further and come to the conclusion that, thus, no justice is possible and we should just game the system as much as possible.
It's an absolute fact that the American legal code has become more much more bloated, and in my opinion, more haphazard, disorganized, and prone to severe contradiction following legal realism becoming a popular philosophy.
It's immediately obviously true in its premise, but some of the conclusions following from legal realism seem to make the justice system worse.
To be clear, I wasn't really suggesting that one should game the system, hence the scare quotes. But a competent lawyer should, in my view, respect the fact that judges are human and respond just like other humans. That means paying attention to little details like dress, demeanor, font, grammar, and all the other elements of presentation that every marketer knows but few lawyers understand.
On a deeper level there are tactics like angling your argument to the judge's world view. (This makes judicial panels all the more important.)
Some vertical error bars would have been helpful on that plot, but having read the original article (from behind the pay wall) I'm pretty satisfied that they thought about all the obvious problems being discussed in these comments. I am a practicing experimental scientist but with minimal knowledge of statistics, so factor that into whatever I say here.
They point out that a negative ruling ("no" or "almost - come back next time") is much easier to deliver. There is less thought involved, nobody will raise eyebrows and the paperwork is much lighter. So the trend is more about mental energy than grumpiness. They note the significance of the breaks, but do not attempt to disentangle the role of mood improvement / a blood sugar boost / rest.
They explicitly discuss the possibility of hidden variables:
"A key aspect for interpreting the association ... is whether an unobserved factor determines case order in such a way that yields the pattern of results we obtain"
The dip and spike patterns in the rulings are quite pronounced, and similar graphs in the article for parameters such as the gravity of the offense, presence of a rehabilitation plan and the number of previous incarcerations do not show any such trends. This addresses questions about case scheduling by the clerks. Besides which - even if the clerks did organize easier cases for later in the day, this would manifest as one long trend over the entire day, not the spike/decay sequence shown.
So I didn't see any gaping holes, and more importantly it seems quite a plausible conclusion to me. Surely you must have had a similar experience going Christmas shopping - you start out thinking very carefully about getting the perfect gift for every person, but after 3 hours trudging around in a mall you'll just buy any old shit so you can go home. As you get tired you just start taking the easiest options.
My theory is that it's more about the judge's blood sugar than about the break. Here's a Science Daily post about one documented case of blood sugar affecting decision-making:
To combat these kind of issues, maybe the law should move to some kind of a majority of three decisions, each hearing being random in all possible senses.
Or we could use tele-judge technology so all defendants can get a hearing with an alert, well-fed judge from another timezone. (I'm only half joking.) This could also be a solution for load-balancing courts among different regions (though the laws may be regional differences).
If you didn't like the judge assigned to your case, and could pull together this kind data on their past decisions, would that be enough to argue for a different judge?
Or perhaps mandate that they eat a snack bar every so often.
Nice article. I would love to see similar data for orchestral auditions. It's common wisdom that it is best to play when the committee is fresh from a break but I'll bet the data would show that that is dramatically the case, since as with parol hearings, rejecting an auditionee would be the default choice.
The fact that the judges can pick their breaks makes me suspicious that there might be a correlation/causation conflation going on here. A possible explanation could be that the workload is trimodal, and judges tend to take breaks after particularly depressing (parole denied) cases.
If the breaks are pretty regular, wouldn't you want to hear more simplified (clear-cut?) cases immediately after a break and more complex ones when more alert?
It’s not possible that someone ordered the cases in a special way. The judges know nothing about upcoming cases ahead of time, so they can’t decide to take a break in the knowledge that an easy positive case is coming up. They also have control over when they set their breaks, so prison staff cannot predictably schedule the hearings in order of ease. And Danziger showed that the judges weren’t any more likely to take a break after particularly difficult cases or severe crimes.
I'm not inclined to purchase the paper, but I would like to see a better explanation of the mechanics of Israeli prison parole hearings before jumping to conclusions.
The big flaw in this study is that while the judges may not know anything about the cases coming up, their clerks do and the clerks are the ones who actually determine the schedule.
Afternoon cases are almost always easier cases because afternoons are largely reserved for actual work: trial/pre-trial hearings, legal research, or paperwork generated by the morning workload. Thus, the clerks always schedule the easiest cases for the afternoon to minimize interference with the important stuff.
[+] [-] jws|15 years ago|reply
The work itself is behind a paywall, but you can read some of the supporting material at http://www.pnas.org/content/suppl/2011/03/30/1018033108.DCSu... to get an idea.
I found the giant line graph problematic because of the hand waving they did to normalize when the breaks occurred during the day. It also disturbs me to see such large, high frequency variation in a line that is averaging a large number of events without explanation.
The dataset certainly begs for a better analysis. For instance, from the supporting material, is there really a judge (the 'X' marker) the never granted parole to the last three people before his morning snack, but granted 70% for the first three of the day on average? All year, for a significant number of cases? Did no one notice that the people before snack time were not getting due process?
[+] [-] shasta|15 years ago|reply
No, that graph is incredible. Literally unbelievable. 70% accepted in the morning to down below 10% before snack? Either this data is BS or there's some hidden variable here.
[+] [-] T-hawk|15 years ago|reply
Also it's worth pointing out that this was a study on Israeli judges. American legal precedents and opinions and scheduling norms may not apply.
[+] [-] chubot|15 years ago|reply
[+] [-] markstansbury|15 years ago|reply
The law is what judges do. So your lawyer had better know how to "manipulate" the judge.
[+] [-] lionhearted|15 years ago|reply
It's an absolute fact that the American legal code has become more much more bloated, and in my opinion, more haphazard, disorganized, and prone to severe contradiction following legal realism becoming a popular philosophy.
It's immediately obviously true in its premise, but some of the conclusions following from legal realism seem to make the justice system worse.
[+] [-] markstansbury|15 years ago|reply
On a deeper level there are tactics like angling your argument to the judge's world view. (This makes judicial panels all the more important.)
[+] [-] flashingleds|15 years ago|reply
They point out that a negative ruling ("no" or "almost - come back next time") is much easier to deliver. There is less thought involved, nobody will raise eyebrows and the paperwork is much lighter. So the trend is more about mental energy than grumpiness. They note the significance of the breaks, but do not attempt to disentangle the role of mood improvement / a blood sugar boost / rest.
They explicitly discuss the possibility of hidden variables: "A key aspect for interpreting the association ... is whether an unobserved factor determines case order in such a way that yields the pattern of results we obtain" The dip and spike patterns in the rulings are quite pronounced, and similar graphs in the article for parameters such as the gravity of the offense, presence of a rehabilitation plan and the number of previous incarcerations do not show any such trends. This addresses questions about case scheduling by the clerks. Besides which - even if the clerks did organize easier cases for later in the day, this would manifest as one long trend over the entire day, not the spike/decay sequence shown.
So I didn't see any gaping holes, and more importantly it seems quite a plausible conclusion to me. Surely you must have had a similar experience going Christmas shopping - you start out thinking very carefully about getting the perfect gift for every person, but after 3 hours trudging around in a mall you'll just buy any old shit so you can go home. As you get tired you just start taking the easiest options.
[+] [-] splat|15 years ago|reply
[+] [-] a-priori|15 years ago|reply
http://www.sciencedaily.com/releases/2010/01/100125173444.ht...
[+] [-] DufusM|15 years ago|reply
[+] [-] cpeterso|15 years ago|reply
[+] [-] khafra|15 years ago|reply
[+] [-] nooneelse|15 years ago|reply
Or perhaps mandate that they eat a snack bar every so often.
[+] [-] jberryman|15 years ago|reply
[+] [-] colanderman|15 years ago|reply
[+] [-] jpwagner|15 years ago|reply
If the breaks are pretty regular, wouldn't you want to hear more simplified (clear-cut?) cases immediately after a break and more complex ones when more alert?
[+] [-] anigbrowl|15 years ago|reply
It’s not possible that someone ordered the cases in a special way. The judges know nothing about upcoming cases ahead of time, so they can’t decide to take a break in the knowledge that an easy positive case is coming up. They also have control over when they set their breaks, so prison staff cannot predictably schedule the hearings in order of ease. And Danziger showed that the judges weren’t any more likely to take a break after particularly difficult cases or severe crimes.
I'm not inclined to purchase the paper, but I would like to see a better explanation of the mechanics of Israeli prison parole hearings before jumping to conclusions.
[+] [-] JacobAldridge|15 years ago|reply
[+] [-] rprasad|15 years ago|reply
Afternoon cases are almost always easier cases because afternoons are largely reserved for actual work: trial/pre-trial hearings, legal research, or paperwork generated by the morning workload. Thus, the clerks always schedule the easiest cases for the afternoon to minimize interference with the important stuff.