A billion-dollar donation: estimating the cost of researchers' time spent on peer review.

Balazs Aczel, Barnabas Szaszi, Alex O Holcombe
Author Information
  1. Balazs Aczel: Present address: Institute of Psychology, ELTE, Eotvos Lorand University, Izabella u. 46, Budapest, 1064, Hungary. balazs.aczel@gmail.com. ORCID
  2. Barnabas Szaszi: Present address: Institute of Psychology, ELTE, Eotvos Lorand University, Izabella u. 46, Budapest, 1064, Hungary. szaszi.barnabas@ppk.elte.hu.
  3. Alex O Holcombe: School of Psychology, University of Sydney, Sydney, Australia.

Abstract

BACKGROUND: The amount and value of researchers' peer review work is critical for academia and journal publishing. However, this labor is under-recognized, its magnitude is unknown, and alternative ways of organizing peer review labor are rarely considered.
METHODS: Using publicly available data, we provide an estimate of researchers' time and the salary-based contribution to the journal peer review system.
RESULTS: We found that the total time reviewers globally worked on peer reviews was over 100 million hours in 2020, equivalent to over 15 thousand years. The estimated monetary value of the time US-based reviewers spent on reviews was over 1.5 billion USD in 2020. For China-based reviewers, the estimate is over 600 million USD, and for UK-based, close to 400 million USD.
CONCLUSIONS: By design, our results are very likely to be under-estimates as they reflect only a portion of the total number of journals worldwide. The numbers highlight the enormous amount of work and time that researchers provide to the publication system, and the importance of considering alternative ways of structuring, and paying for, peer review. We foster this process by discussing some alternative models that aim to boost the benefits of peer review, thus improving its cost-benefit ratio.

Keywords

References

  1. Thorac Cardiovasc Surg. 2021 Aug;69(5):387-388 [PMID: 34229353]
  2. Regul Toxicol Pharmacol. 2019 Apr;103:73-85 [PMID: 30634024]
  3. PLoS One. 2016 Nov 10;11(11):e0166387 [PMID: 27832157]
  4. PLoS One. 2019 Oct 30;14(10):e0223976 [PMID: 31665156]
  5. Scientometrics. 2010 Sep;84(3):575-603 [PMID: 20700371]
  6. Res Integr Peer Rev. 2020 Aug 5;5:11 [PMID: 32774892]
  7. Ann Emerg Med. 2006 Dec;48(6):750-6, 756.e1-21 [PMID: 16978740]
  8. Nature. 2017 Mar 23;543(7647):599 [PMID: 28358109]
  9. PLoS One. 2018 May 11;13(5):e0196914 [PMID: 29750807]
  10. PLoS One. 2016 Mar 09;11(3):e0149504 [PMID: 26960191]

Word Cloud

Created with Highcharts 10.0.0peerreviewtimeresearchers'alternativesystemreviewersmillionUSDamountvalueworkjournallaborwaysprovideestimatetotalreviews2020spentBACKGROUND:criticalacademiapublishingHoweverunder-recognizedmagnitudeunknownorganizingrarelyconsideredMETHODS:Usingpubliclyavailabledatasalary-basedcontributionRESULTS:foundgloballyworked100hoursequivalent15thousandyearsestimatedmonetaryUS-based15billionChina-based600UK-basedclose400CONCLUSIONS:designresultslikelyunder-estimatesreflectportionnumberjournalsworldwidenumbershighlightenormousresearcherspublicationimportanceconsideringstructuringpayingfosterprocessdiscussingmodelsaimboostbenefitsthusimprovingcost-benefitratiobillion-dollardonation:estimatingcostAcademicpublishersPeer-reviewPublication

Similar Articles

Cited By