> He would much prefer to see theses’ introductory sections “written along the lines of a good review article, where the student does a critical appraisal of the state of the field”.
Yes! A well-written thesis continues to be a very valuable contribution to the literature, but it is the parts that are not original work that are most useful. The reason is that older researchers in a field have almost no incentives to write good and truly introductory review papers, and the introductory sections of a thesis are often the best point of entry.
However, most theses are not well written because student don't have much incentive either.
> Hence, theses become bloated with “page after page of methods”, along the lines of: “I pipetted 2.5ml of this enzyme into that tube.”
Yea, it's boring for professor on the thesis committee to read, but this sort of stuff is very valuable for students and postdocs, who often struggle to reproduce poorly-documented results from other labs.
> "Communication within the science world and with the public is becoming shorter and snappier, yet our PhDs still seem to be stuck in the 1960s.”
Yes, if anything we need better documentation of methods. This is something often overlooked with the open-scientific-data movement also: data on its own is not very useful (in the sense of being insufficient to draw valid conclusions) if you don't have good documentation of how precisely it was collected, which is critical to interpreting it correctly... otherwise you just have some numbers in a CSV file. Traditionally PhD theses are one of the few places that really exhaustively documents what exactly they did and how, while papers tend to gloss over a lot of things. There's been a little noise about that [1], but not a lot of movement so far.
I do think a movement of theses away from monograph-style to collection-of-articles style is okay, though.
Good comment. My addendum to follow is not directed to you, but to non-scientific readership.
Yea, it's boring for professor on the thesis committee to read, but this sort of stuff is very valuable for students and postdocs, who often struggle to reproduce poorly-documented results from other labs.
There's both absolute and relative poor documentation. The brevity of most scientific publishing (coupled with the lack of any sort of external incentive for clarity, as you point out) means that even papers that are good, by the standard of scientific papers, can be a real bear to turn into working examples. I personally feel that a lot of what makes various labs good is knowledge of the things that aren't going into the papers. A dissertation, with (potentially) a lot more room to go into details, can serve both as a source of this information for external readers, as well as a convenient internal reference for people in the lab who need to dig up some details of their prehistory.
edit: to clarify, my perspective on this is coming from physics. In other fields, there's more of an emphasis on explicit protocols and "methods sections" that presumably help with this sort of thing.
Agreed! Not every thesis is great, but most research isn't great either. Good students write good theses and I've found many with whole chapters on important topics that are just glossed over in the research papers.
Look, a lot of things don't need 100 pages of text. Of course, as a researcher, what you don't want to do is to make your research easy to read, because people may then assume that it was easy to do and therefore not impressive.
The doctoral thesis already is already essentially universally several papers stapled together in experimental science and engineering. The shortest compelling way to explain your results is a paper. Furthermore, the notion that your work over 3-8 years is one cohesive story has been violated by every graduate student I've ever met.
My thesis (in math / CS) was essentially several papers stapled together, except that I made the papers into chapters, expanded/rewrote bits and pieces, and added narrative to glue the chapters together.
This took about six months. In retrospect, I think this time was well spent. I developed my understanding of the material quite substantially by reworking it. But doing so was certainly not nearly as fun as writing new papers.
Yep, my math PhD was literally 4 submitted papers placed together with an introduction section to the topic area. This wasn't 100% common in my department (US public state university), but my advisor strongly suggested it as the most efficient way to go.
Depends very much on the field. Everyone I knew in experimental physics was focused on a single experiment or type of apparatus, generally an attempt to measure a single number (or rather, because it was all "physics beyond the standard model", an attempt to set a new limit on a single number.)
What constitutes a staple-thesis varies a bit though. My advisor required 3 top-tier papers in a well-defined topic. Papers in other topics or workshop papers does not count.
The UK process is great if the student's goal is to gain a PhD. After approximately 3 years of running experiments, you present your hypotheses and gather together your results and try to make it look like these are related.
If the goal is to have an academic career, this is not adequate. Graduating without having results that are good enough to publish in peer reviewed articles puts the UK student far behind others around the world who'll be competing for postdocs.
Having moved from a high profile lab in the UK to a high profile lab in the US, I was shocked at how far behind the US/French/German postdocs I was.
This is so true. A UK PhD is a gloried three year honours degree. Here in Australia traditionally PhDs averaged over 4 years (I took nearly 5 years, but I was working full time for the last 18 months after my scholarship ran out). I knew only one person who finished in the regulation time of three years - most people got most of their results in the last year.
When I was an academic my university put great pressure on us to get our students out in under 3 years citing the UK system. Of course when we raised the problems the UK system (ie having our students graduate with no papers) would have on them we were told basically to shut up and do what ever it took to get the students out on time. It became pretty common for supervisors to write their students dissertation and for more senior researchers to 'gift' results to students to get them out on time.
This was not my experience. My UK Computer Science peer group was expected to publish their thesis work in a good journal, with some conference papers along the way. The thesis was the definitive long-form version, but a key question at the defence was "so where was this work published?". "It wasn't" would not have been a good answer.
"But Leigh argues that unlucky students with no results “shouldn’t be getting a PhD anyway”, since the degree is awarded “for a contribution to knowledge, not for a good try”."
Translation: never do work on anything that has even the possibility of failure.
Yeah, what a great way to advance knowledge.
This is just another extension of "negative results have no value in science".
Although my opinion is unsubstantiated, the biggest problem is the barrier of knowledge : it takes longer and longer to familiarize yourself with an increasingly growing body of literature. Second, the low-hanging fruit tends to be picked, leaving researchers fighting for the few undiscovered scraps the remain. Third, papers are getting longer and more technical, with more data and co-authors. Forth, much longer approval times, high submission fees, and much higher rejection rates. Research seems to be a team effort now, of many people collaborating over years to publish papers that are very lengthy and technical that reflect only incremental progress in a field.
I think there is always low hanging fruit, you just have to know where to find it. Agreed that publishing papers, especially in top conferences, takes more of a team effort now.
This article seems to adequately describe the definition and obvious shortcomings of the word _thesis_; which is what a _masters_ student should be doing. A _doctoral_ student should be doing a _dissertation_.
I'm not sure why so many people want a doctoral degree, as opposed to a masters. It doesn't offer significant financial return on the investment over the masters and it's only really required for entrance to the ivory tower... and once you're there you're going to be dealing with way more B.S. than the horrors of writing an introduction...
The entire point of the dissertation is to formulate a complete picture of where things belong and how they interact. It should start from nothing and progress to your contribution. _It should outline pitfalls, mistakes, musings, ideas, future works, etc._ all things which are included in paper publications only minimally (and often requested removed by referees for being off topic!).
Yes, it takes 6 months of headbashing LaTeX editing and it comes out with stupid errors on the front page and no one will ever read it besides yourself and your advisors; but that's honestly one of the best lessons you can learn about life in the ivory tower... You _will_ waste months of your life going nowhere, you _will_ have headbashingly mundane paperwork to do more than you like to think, you _will_ screw it up (and need to understand that every paper has some dirty little secret), you _will_ babble on about things no one cares about... That's what being an academic is!
If you just care about progress for publications and get a pained feeling when your time appears (appears! every fuck up is a valuable lesson) to have been wasted, then you are not an academic and, yes, the experience will be pointless for you.
The truly disgusting thing is these advisors who are streamlining and mechanizing the process. Go ahead and check out which schools pump out the most PhDs per faculty and per time invested (China and India? I'm fairly certain?). Which journals will accept the most articles per time invested (again the same). Are these places onto something no one else is onto? They are capable of producing far more quickly and efficiently than the "archaic" systems...
This is only a critique of the monograph-type PhD thesis, which I agree that should become obsolete.
Where I come from, a thesis is 3-6 published papers and a 20-60 pages introduction/summary that explains the background a bit more than is traditional in a paper, and summarizes the results.
Yes, the student spends 1-3 months writing the summary part, but most of their time is spent on research and writing the actual papers.
Reasons for thesis taking too long (and approximate time dealing with them):
- Writer's block: couple of weeks
- Dealing with braindead typeset standards, even with things like LateX libraries/helpers (some people still do it in Word): A couple of weeks to months
- Dealing with all the citations (because whatever you write, barring the most obvious, has to be quoted): one-two months
[+] [-] jessriedel|11 years ago|reply
Yes! A well-written thesis continues to be a very valuable contribution to the literature, but it is the parts that are not original work that are most useful. The reason is that older researchers in a field have almost no incentives to write good and truly introductory review papers, and the introductory sections of a thesis are often the best point of entry.
However, most theses are not well written because student don't have much incentive either.
> Hence, theses become bloated with “page after page of methods”, along the lines of: “I pipetted 2.5ml of this enzyme into that tube.”
Yea, it's boring for professor on the thesis committee to read, but this sort of stuff is very valuable for students and postdocs, who often struggle to reproduce poorly-documented results from other labs.
> "Communication within the science world and with the public is becoming shorter and snappier, yet our PhDs still seem to be stuck in the 1960s.”
Ahh yes, just what we need. Thesis-by-tweet...
[+] [-] _delirium|11 years ago|reply
I do think a movement of theses away from monograph-style to collection-of-articles style is okay, though.
[1] http://scholarlykitchen.sspnet.org/2014/11/18/nevermind-the-...
[+] [-] bkcooper|11 years ago|reply
Yea, it's boring for professor on the thesis committee to read, but this sort of stuff is very valuable for students and postdocs, who often struggle to reproduce poorly-documented results from other labs.
There's both absolute and relative poor documentation. The brevity of most scientific publishing (coupled with the lack of any sort of external incentive for clarity, as you point out) means that even papers that are good, by the standard of scientific papers, can be a real bear to turn into working examples. I personally feel that a lot of what makes various labs good is knowledge of the things that aren't going into the papers. A dissertation, with (potentially) a lot more room to go into details, can serve both as a source of this information for external readers, as well as a convenient internal reference for people in the lab who need to dig up some details of their prehistory.
edit: to clarify, my perspective on this is coming from physics. In other fields, there's more of an emphasis on explicit protocols and "methods sections" that presumably help with this sort of thing.
[+] [-] platz|11 years ago|reply
[+] [-] nickm12|11 years ago|reply
[+] [-] TheOtherHobbes|11 years ago|reply
[+] [-] tormeh|11 years ago|reply
Look, a lot of things don't need 100 pages of text. Of course, as a researcher, what you don't want to do is to make your research easy to read, because people may then assume that it was easy to do and therefore not impressive.
[+] [-] probdist|11 years ago|reply
[+] [-] fdej|11 years ago|reply
This took about six months. In retrospect, I think this time was well spent. I developed my understanding of the material quite substantially by reworking it. But doing so was certainly not nearly as fun as writing new papers.
[+] [-] thearn4|11 years ago|reply
[+] [-] tjradcliffe|11 years ago|reply
[+] [-] asabjorn|11 years ago|reply
[+] [-] sillypog|11 years ago|reply
If the goal is to have an academic career, this is not adequate. Graduating without having results that are good enough to publish in peer reviewed articles puts the UK student far behind others around the world who'll be competing for postdocs.
Having moved from a high profile lab in the UK to a high profile lab in the US, I was shocked at how far behind the US/French/German postdocs I was.
[+] [-] danieltillett|11 years ago|reply
When I was an academic my university put great pressure on us to get our students out in under 3 years citing the UK system. Of course when we raised the problems the UK system (ie having our students graduate with no papers) would have on them we were told basically to shut up and do what ever it took to get the students out on time. It became pretty common for supervisors to write their students dissertation and for more senior researchers to 'gift' results to students to get them out on time.
[+] [-] robotresearcher|11 years ago|reply
Expectations may vary by school.
[+] [-] bsder|11 years ago|reply
"But Leigh argues that unlucky students with no results “shouldn’t be getting a PhD anyway”, since the degree is awarded “for a contribution to knowledge, not for a good try”."
Translation: never do work on anything that has even the possibility of failure.
Yeah, what a great way to advance knowledge.
This is just another extension of "negative results have no value in science".
[+] [-] paulpauper|11 years ago|reply
[+] [-] anonymousDan|11 years ago|reply
[+] [-] stellographer|11 years ago|reply
I'm not sure why so many people want a doctoral degree, as opposed to a masters. It doesn't offer significant financial return on the investment over the masters and it's only really required for entrance to the ivory tower... and once you're there you're going to be dealing with way more B.S. than the horrors of writing an introduction...
The entire point of the dissertation is to formulate a complete picture of where things belong and how they interact. It should start from nothing and progress to your contribution. _It should outline pitfalls, mistakes, musings, ideas, future works, etc._ all things which are included in paper publications only minimally (and often requested removed by referees for being off topic!).
Yes, it takes 6 months of headbashing LaTeX editing and it comes out with stupid errors on the front page and no one will ever read it besides yourself and your advisors; but that's honestly one of the best lessons you can learn about life in the ivory tower... You _will_ waste months of your life going nowhere, you _will_ have headbashingly mundane paperwork to do more than you like to think, you _will_ screw it up (and need to understand that every paper has some dirty little secret), you _will_ babble on about things no one cares about... That's what being an academic is!
If you just care about progress for publications and get a pained feeling when your time appears (appears! every fuck up is a valuable lesson) to have been wasted, then you are not an academic and, yes, the experience will be pointless for you.
The truly disgusting thing is these advisors who are streamlining and mechanizing the process. Go ahead and check out which schools pump out the most PhDs per faculty and per time invested (China and India? I'm fairly certain?). Which journals will accept the most articles per time invested (again the same). Are these places onto something no one else is onto? They are capable of producing far more quickly and efficiently than the "archaic" systems...
Just wait 5 years and see why that's a mistake.
[+] [-] sampo|11 years ago|reply
Where I come from, a thesis is 3-6 published papers and a 20-60 pages introduction/summary that explains the background a bit more than is traditional in a paper, and summarizes the results.
Yes, the student spends 1-3 months writing the summary part, but most of their time is spent on research and writing the actual papers.
[+] [-] raverbashing|11 years ago|reply
- Writer's block: couple of weeks
- Dealing with braindead typeset standards, even with things like LateX libraries/helpers (some people still do it in Word): A couple of weeks to months
- Dealing with all the citations (because whatever you write, barring the most obvious, has to be quoted): one-two months
- Nitpicking by advisor: some weeks
[+] [-] danieltillett|11 years ago|reply
[+] [-] IndianAstronaut|11 years ago|reply
Lucky you. I was told to completely redo mine by my advisor.
[+] [-] eli_gottlieb|11 years ago|reply
- Running and rerunning raw experiment (3 months)
- Running and rerunning statistical analyses (2 months)
[+] [-] Rhapso|11 years ago|reply
[+] [-] fnazeeri|11 years ago|reply
Crick et al wrote a 1-page paper (on the structure of DNA) for which they won a Nobel Prize back in 1953.
[+] [-] GFK_of_xmaspast|11 years ago|reply
[+] [-] paulpauper|11 years ago|reply