No, please. There are still fields where journals are both open-access and not pay-to-publish. This is because they are published by the same non-profit learned societies they always have been for many decades, and overhead costs are low.
Bring in a culture of paying peer reviewers, and suddenly authors (or the learned society) will be under more pressure to get more grant money to pay the new publication costs. Also, as someone who works in academia on an occasional basis, taking years off from funded positions at a time, I appreciate being able to write the occasional article on my own time and get it published without paying hundreds and hundreds of euro out of my own pocket -- fields with pay-to-publish traditions make it hard for non-permanent faculty to contribute.
This is insightful, thanks, but there's a little problem here:
The cost is borne one way or the other, the $500 is a matter of comp, not cost.
If someone is going to review your work, that's an act of very material labour. That they are not really compensated for it, at all, is inconsistent with the basic premise of labour and comp.
You would not be a researcher if you weren't comped in some way, so the absence and/or misalignment of comp is the issue.
It's not free to publish and have 2 reviewers (!!) there is a very material cost that you're just not paying.
Allocating at $1K cost for publication more accurately reflects the labour involved in checking it out (at least a little bit).
It'd seem to me a lot of folks might want to take up the $500/review as a job to earn some reasonable income, they might even get good at it.
It's entirely plausible that one of the 'dysfunctions' of science is 'not enough review' and it's simply because there is no incentive structure for it at all.
We pay people for literally every other function in life. Doctors are paid to 'save lives' even though there is a moral obligation. The notion that we don't pay people for academic work seems odd.
Perhaps journals could identify the papers with the most promise and offer payment for review, or something like that.
The system is wickedly broken. Is there a way to fix the reproduction issue in science that has been raging for decades, without affecting the good players? I'm not sure there is.
I've seen some journals do this. The problem TBH is that the amounts paid aren't enough to be an incentive. Typically £50-100. A good review takes a day to do (maybe more). And academics are probably paid £100/day or more anyway, and aren't very money-motivated.
I think a better approach would be publicity. Academics care about reputation a lot. If good reviewers were acknowledged by the journal, that would be a big incentive, something you could put on your CV.
Great point. Offering to pay a small amount could actually reduce the number of people willing to review, since they are currently motivated by a sense of duty. Reminds me of the Freakonomics chapter with the day care: https://freakonomics.com/2013/10/23/what-makes-people-do-wha...
Journals should not shed out tiny payments for peer reviews by overworked faculty, they should hire teams of reviewers with diverse specialisations full time. By decent quality assurance on the massive amount of papers each year publishers could actually do something valuable for science.
I don't necessarily disagree with paying reviewers, but I think there is some value to having people who are actively working on problems in the same area being the ones doing the reviewing. Yes, it's additional work that we aren't paid for, but personally I enjoy it. I do agree though that for some it can create undue pressure so there may be something in the middle there that works well.
That would be difficult in a fields with a vast range of specializations (physics for sure). They would really need an army of reviewers to cover everything from astronomy to particle physics.
Looking at the real-estate market and its assortment of minimal-value-add/maximum-value-extraction players (appraisals, title insurance firms, 75% of inspectors) as an analog, I suspect that directly paying for reviews will not likely improve the situation.
Perhaps a recognition by institution or university model would work, or softening the dollars (they are credits against APCs or something) might work.
Many universities take reviewing "into account " for the tenure-track process and performance reviews. but it counts really little compared to publications. Data sharing or management of ressources (databases, forums...) is completely ignored usually.
Like many other recent international hires at US universities, I'm on H-1B visa. If paying for reviews was the norm, I believe it would be illegal for me to review papers, even for free.
I'm not sure what to think about this. Peer review is an important way of contributing to the community, and every academic is expected to participate in it. Commercial publishers that make profits from free academic labor are parasites, and they should pay for the services they use. Yet immigration rules often make it difficult to earn any side income, so paying for reviews would exclude many (often less established) academics.
That is a good point and one I hadn't considered despite being an H-1B holder myself. I agree with your argument that paying for reviews under current immigration laws would be highly problematic for visa holders. It would either mean we would be expected to do it for free when everyone else gets paid, which would be unfair and potentially still not legal. Or we would be unable to review which I think is an important part of establishing oneself within the community.
I don't think the process would be less effective if papers were published without peer review, but were then questioned and challenged in public debate under editorial moderation.
Peer review isn't a single-goal process. It exists to introduce citations of existing work if they aren't already referenced, to question assumptions, and to find obvious errors. (Among others.)
All of these could be done in peer debate.
It's not as if the process is genuinely anonymous anyway. Of course it pretends to be, but it isn't.
Peer review dates from the days when information travelled as fast as a horse, and it made sense to include a review stage for basic quality control.
I'm not convinced it's a good model now, when information exchange is rather quicker.
The real problem is that journal publication is about career status, not about quality of work. Peer review is almost a side issue.
The scientific publishing industry is not just financially parasitic, it also introduces unnecessary delays in idea exchange. Public peer debate would eliminate some of that friction, but it would also have public consequences for reputation - and that might well be more effective for quality control than pseudo-anonymity.
At least in my field, I expect this would be a total disaster. One of the major advantages of peer review is that knowing the top tier publication venues, I can look to these to keep up to date on the latest work knowing that what I find is likely to be high quality. In the absence of peer-reviewed publication venues, I see two options:
1. Read everything I can find that is published and try to sort through it all myself to sort out what is good quality. I think in aggregate, this is likely to take more of researchers' time than contributing to the peer review process.
2. Focus only on publications from top quality institutions or researchers whose work I am already familiar with. This has the advantage of saving me time. But it also has the massive disadvantage that I am likely to miss quality work which comes from lesser known institutions or authors.
I don't think either of those two options is attractive. In my field, the delay of idea exchange is not really a problem. If people want to share their ideas, they can often publish a preprint in parallel with submission to a peer-reviewed journal. (Although some journals effectively prohibit this since it has the potential to break the anonymity of the review process.)
Yes, some of the purposes of peer review could be accomplished in the method of "peer debate" you mention. But I think such a process would be much less effective. Of course, that's not to say I don't think there are things broken about peer review that could use fixing :)
Can’t we jus my have a GitHub for science and get this over with? It seems silly to maintain this system that may have been functional when it started, but is now clearly behind the technology curve.
How would that address the core question being asked which is whether work spent reviewing should be paid? In any case, while there are problems with peer review, I don't think it's related to technology.
If the journal is paying a reviewer would there be more pressure in terms of turn around time? Or more pressure to accept contentious papers because the journal expects them to be highly cited or wants to pander to their authors?
I also imagine there would be people out there who would become serial reviewers with the goal of making as much money as possible. I imagine the quality of their reviews wouldn't be great either.
For turnaround time, I would probably say yes. Right now it's typically to have several months to review a journal paper. And there's really not much a journal can do if a reviewer is late other than not ask them to review again. Even if reviewers were paid, I suspect it would be difficult from a budgetary perspective to difficult to have serial reviewing be lucrative with the possible exception of adjunct faculty who unfortunately are typically very underpaid.
So, if the problem is that scientists lack motivation to peer review, I think having peer review work recognized as important in tenure-and-promotion would probably be far more motivating than whatever hourly rate they'd end up paying.
Article authors are generally not paid! Yet there is no lack of motivation to write articles.
How to motivate to do peer-review well instead of perfunctorily is another question.
Article authors often pay as well. Either directly because the journal is a science-tabloid or because the authors want to make their work accessible to all. Or indirectly through the indirect cost the universities are taking from grant agencies to pay for their confidential agreements with publishers. Try to do a FOIA of a state university to get that information you will see how hard they will fight the fact that they get scammed.
Authors write because this is how you justify that you are really working, be it for your university, department or your grant agency. Also you want others to build upon your work, but academics would publish a lot less if it was not for the huge pressure from funders and employers (increasing numbers is all that count for many of them).
I would argue that article authors generally are paid indirectly by the institution which employs them. Most scientific publications are authored by academics or members of research labs who are specifically paid to publish. Of course, pay is not directly tied to each publication, but that is what most authors are paid for. At least in my institution, contributing to the peer review process is also an expected part of the process to achieve tenure. But the incentive is certainly far less than the incentive to publish.
I think the problem with this is that it can encourage retaliation. If I know you rejected my paper, I might be incline to reject yours. Now, a nobody like me probably can't get away with doing that to someone with an established reputation. But the other way around is certainly possible.
Hunh, this is a great idea. Rejected articles should be published as rejected, and all reviews should be published. I guess this is a bit like the open review model, like The Cryosphere uses, except I think they hide papers after the discussion period if they aren't accepted.
How about making reviews available under the name of the reviewer. This means good reviewers can get respect of their reviewees, and reviewers are incentivized to write with slightly more consideration.
Similarly, universities should value good reviewers more. Which probably means reviewers need to get more prestige, so universities get prestige for having good reviewers.
This is something that is pushed by some people. With many journals I review for however, I am able to see otger reviewers reviews and I suppose they would be ashamed to have their names to be associated with them (extremely short and with generoc sentences that looks like they didnt even read the paper or just plainly agressive). I've heard many arguments against open review, but the most common is that people are afraid of retaliations if they criticize a work. I understand that people have retaliated to me after comments on PubPeer. But I still think we should do open reviews, that doesnt mean that journals that make people pay for publishing or reading should pay reviewers. We work for free get 0 reward... It is a bit like asking a designer to work for you, and tell them that it is to help the world of design and thank you no you can't sign...
Is there a way this can be made double-blind, where the Journal doesn't know the reviewer and the reviewer doesn't know the Journal? Can something akin to Mechanical Turk be utilized? Just trying to think of ways to have paid reviews without incurring all the negatives so typically associated with that arrangement.
I’d rather just reduce the number of for profit journals. Getting paid $450 seems to be against open access as open journals can’t afford this.
Also the motivations are different when pay is involved. I will donate time to peer review, but $450 is not enough to pay me. So I would be more likely to review as a volunteer than an employee.
I agree we don't need the publishers anymore. We have preprint services (arxiv and others), open review systems (pubpeer), sharing platforms (osf, zenodo, dataverse). You have Free software to handle all the manuscript lifecycle (there are a few cant remember the names). We keep the publishers because they still have some prestige and they are blackmailing university libraries. Now there is Scihub to go atound that, but of course there are ethical and legal reasons associated with its use so in my opinion thats not a long term alternative.
I want to contend that to most non-tenured professors (outside of the States at least?) 450$, even if not enough as pay either would be a nice extra from time to time.
Can you share some of these non profits? I work at one who used to publish a journal for decades, but Sage has handled it in more recent memory. We make our salaries through grants and a library product. But I am not aware of others doing similar work. Partially out of ignorance.
If that programmer doesn't work for your company and you want them to do it in a timely manner, then yes, I think it's reasonable to do so. For open access publications, you could argue that reviewing is similar to working on an open source project, but open access is still the exception, not the norm.
Well, I much more like the question: Should authors pay for their publications? There is a common pun: As a scientist, you pay two times for an article: The one time you publish, and the other time when you subscribe to read your published article. And this is only to access the article as a PDF in the web. There is no print copy or so involved in that payment.
You usually have three models:
- pay for publish and read: big tabloid journals, large medical maf... associations. Cost to publish is usually below $1000, cost to read is $5-$20 a page
- pay for read, free to publish: most journals from the big publishers. Cost is between $5 to $20 a page.
- pay to publish, free to read: the model of most Open Access journals. Some big publishers are proposing that as an option as well. Cost of that option is usually $3000 to $5000 per article.
This depends on the field. I have never paid to publish and I doubt I ever would. (This does not count however the conference expenses typically required of an author to present their paper. But attending a conference has significant benefit to me personally, so I don't really see it as a direct cost of publication.)
[+] [-] Mediterraneo10|5 years ago|reply
Bring in a culture of paying peer reviewers, and suddenly authors (or the learned society) will be under more pressure to get more grant money to pay the new publication costs. Also, as someone who works in academia on an occasional basis, taking years off from funded positions at a time, I appreciate being able to write the occasional article on my own time and get it published without paying hundreds and hundreds of euro out of my own pocket -- fields with pay-to-publish traditions make it hard for non-permanent faculty to contribute.
[+] [-] foobarbecue|5 years ago|reply
I don't think your idea that publication costs need to increase to pay reviewers is valid. Elsevier et al would just cut some of their obscene bloat.
[+] [-] jariel|5 years ago|reply
The cost is borne one way or the other, the $500 is a matter of comp, not cost.
If someone is going to review your work, that's an act of very material labour. That they are not really compensated for it, at all, is inconsistent with the basic premise of labour and comp.
You would not be a researcher if you weren't comped in some way, so the absence and/or misalignment of comp is the issue.
It's not free to publish and have 2 reviewers (!!) there is a very material cost that you're just not paying.
Allocating at $1K cost for publication more accurately reflects the labour involved in checking it out (at least a little bit).
It'd seem to me a lot of folks might want to take up the $500/review as a job to earn some reasonable income, they might even get good at it.
It's entirely plausible that one of the 'dysfunctions' of science is 'not enough review' and it's simply because there is no incentive structure for it at all.
We pay people for literally every other function in life. Doctors are paid to 'save lives' even though there is a moral obligation. The notion that we don't pay people for academic work seems odd.
Perhaps journals could identify the papers with the most promise and offer payment for review, or something like that.
[+] [-] arbitrage|5 years ago|reply
[+] [-] the_duke|5 years ago|reply
I surmise the amount is anywhere between small and tiny.
There are arguments against paying peer reviewers, but this is not a good one.
[+] [-] dash2|5 years ago|reply
I think a better approach would be publicity. Academics care about reputation a lot. If good reviewers were acknowledged by the journal, that would be a big incentive, something you could put on your CV.
[+] [-] foobarbecue|5 years ago|reply
[+] [-] dairyleia|5 years ago|reply
[+] [-] DanielleMolloy|5 years ago|reply
[+] [-] michaelmior|5 years ago|reply
[+] [-] piokoch|5 years ago|reply
[+] [-] sokoloff|5 years ago|reply
[+] [-] zackkatz|5 years ago|reply
[+] [-] sokoloff|5 years ago|reply
Perhaps a recognition by institution or university model would work, or softening the dollars (they are credits against APCs or something) might work.
[+] [-] ta988|5 years ago|reply
[+] [-] jltsiren|5 years ago|reply
I'm not sure what to think about this. Peer review is an important way of contributing to the community, and every academic is expected to participate in it. Commercial publishers that make profits from free academic labor are parasites, and they should pay for the services they use. Yet immigration rules often make it difficult to earn any side income, so paying for reviews would exclude many (often less established) academics.
[+] [-] michaelmior|5 years ago|reply
[+] [-] TheOtherHobbes|5 years ago|reply
Peer review isn't a single-goal process. It exists to introduce citations of existing work if they aren't already referenced, to question assumptions, and to find obvious errors. (Among others.)
All of these could be done in peer debate.
It's not as if the process is genuinely anonymous anyway. Of course it pretends to be, but it isn't.
Peer review dates from the days when information travelled as fast as a horse, and it made sense to include a review stage for basic quality control.
I'm not convinced it's a good model now, when information exchange is rather quicker.
The real problem is that journal publication is about career status, not about quality of work. Peer review is almost a side issue.
The scientific publishing industry is not just financially parasitic, it also introduces unnecessary delays in idea exchange. Public peer debate would eliminate some of that friction, but it would also have public consequences for reputation - and that might well be more effective for quality control than pseudo-anonymity.
[+] [-] michaelmior|5 years ago|reply
1. Read everything I can find that is published and try to sort through it all myself to sort out what is good quality. I think in aggregate, this is likely to take more of researchers' time than contributing to the peer review process.
2. Focus only on publications from top quality institutions or researchers whose work I am already familiar with. This has the advantage of saving me time. But it also has the massive disadvantage that I am likely to miss quality work which comes from lesser known institutions or authors.
I don't think either of those two options is attractive. In my field, the delay of idea exchange is not really a problem. If people want to share their ideas, they can often publish a preprint in parallel with submission to a peer-reviewed journal. (Although some journals effectively prohibit this since it has the potential to break the anonymity of the review process.)
Yes, some of the purposes of peer review could be accomplished in the method of "peer debate" you mention. But I think such a process would be much less effective. Of course, that's not to say I don't think there are things broken about peer review that could use fixing :)
[+] [-] AcerbicZero|5 years ago|reply
[+] [-] michaelmior|5 years ago|reply
[+] [-] gww|5 years ago|reply
I also imagine there would be people out there who would become serial reviewers with the goal of making as much money as possible. I imagine the quality of their reviews wouldn't be great either.
[+] [-] michaelmior|5 years ago|reply
[+] [-] ta988|5 years ago|reply
[+] [-] jrochkind1|5 years ago|reply
Article authors are generally not paid! Yet there is no lack of motivation to write articles.
How to motivate to do peer-review well instead of perfunctorily is another question.
[+] [-] ta988|5 years ago|reply
Authors write because this is how you justify that you are really working, be it for your university, department or your grant agency. Also you want others to build upon your work, but academics would publish a lot less if it was not for the huge pressure from funders and employers (increasing numbers is all that count for many of them).
[+] [-] michaelmior|5 years ago|reply
[+] [-] karl11|5 years ago|reply
[+] [-] michaelmior|5 years ago|reply
[+] [-] foobarbecue|5 years ago|reply
[+] [-] rocqua|5 years ago|reply
Similarly, universities should value good reviewers more. Which probably means reviewers need to get more prestige, so universities get prestige for having good reviewers.
[+] [-] ta988|5 years ago|reply
[+] [-] taylodl|5 years ago|reply
[+] [-] prepend|5 years ago|reply
Also the motivations are different when pay is involved. I will donate time to peer review, but $450 is not enough to pay me. So I would be more likely to review as a volunteer than an employee.
[+] [-] ta988|5 years ago|reply
[+] [-] RBerenguel|5 years ago|reply
[+] [-] mgr86|5 years ago|reply
[+] [-] unknown|5 years ago|reply
[deleted]
[+] [-] pulse7|5 years ago|reply
[+] [-] jmakov|5 years ago|reply
[+] [-] michaelmior|5 years ago|reply
[+] [-] ktpsns|5 years ago|reply
Notorious XKCD: https://xkcd.com/2085/
[+] [-] ta988|5 years ago|reply
- pay for read, free to publish: most journals from the big publishers. Cost is between $5 to $20 a page.
- pay to publish, free to read: the model of most Open Access journals. Some big publishers are proposing that as an option as well. Cost of that option is usually $3000 to $5000 per article.
[+] [-] michaelmior|5 years ago|reply