Investigating and preventing scientific misconduct using Benford's Law.

Gregory M Eckhartt, Graeme D Ruxton
Author Information
  1. Gregory M Eckhartt: School of Biology, University of St Andrews, St Andrews, KY16 9TH, UK. gregoryeckhartt@gmail.com.
  2. Graeme D Ruxton: School of Biology, University of St Andrews, St Andrews, KY16 9TH, UK.

Abstract

Integrity and trust in that integrity are fundamental to academic research. However, procedures for monitoring the trustworthiness of research, and for investigating cases where concern about possible data fraud have been raised are not well established. Here we suggest a practical approach for the investigation of work suspected of fraudulent data manipulation using Benford's Law. This should be of value to both individual peer-reviewers and academic institutions and journals. In this, we draw inspiration from well-established practices of financial auditing. We provide synthesis of the literature on tests of adherence to Benford's Law, culminating in advice of a single initial test for digits in each position of numerical strings within a dataset. We also recommend further tests which may prove useful in the event that specific hypotheses regarding the nature of data manipulation can be justified. Importantly, our advice differs from the most common current implementations of tests of Benford's Law. Furthermore, we apply the approach to previously-published data, highlighting the efficacy of these tests in detecting known irregularities. Finally, we discuss the results of these tests, with reference to their strengths and limitations.

Keywords

References

  1. Biol Rev Camb Philos Soc. 2013 May;88(2):465-75 [PMID: 23253069]
  2. PLoS One. 2010 Apr 21;5(4):e10271 [PMID: 20422014]
  3. R Soc Open Sci. 2019 Jul 3;6(7):190474 [PMID: 31417746]
  4. Biol Lett. 2018 Apr;14(4): [PMID: 29669847]
  5. Proc Biol Sci. 2013 Dec 11;281(1776):20132703 [PMID: 24335987]
  6. J Biomed Inform. 2018 Jul;83:25-32 [PMID: 29783038]
  7. Adv Cogn Psychol. 2017 Jun 30;13(2):121-127 [PMID: 28713450]
  8. J Clin Epidemiol. 2022 Nov;151:1-17 [PMID: 35850426]
  9. Anaesthesist. 2012 Jun;61(6):543-9 [PMID: 22695776]
  10. PLoS One. 2022 Jul 22;17(7):e0271969 [PMID: 35867697]
  11. Proc Biol Sci. 2020 Jan 29;287(1919):20200077 [PMID: 31992140]
  12. PLoS One. 2010 May 07;5(5):e10541 [PMID: 20479878]
  13. Anaesthesist. 2017 Oct;66(10):795-802 [PMID: 28653153]
  14. F1000Res. 2023 May 30;11:783 [PMID: 37360941]
  15. Biol Rev Camb Philos Soc. 2002 May;77(2):211-22 [PMID: 12056747]
  16. Biol Lett. 2014 Aug;10(8): [PMID: 25165452]
  17. Cochrane Database Syst Rev. 2009 Jan 21;(1):MR000006 [PMID: 19160345]
  18. Lancet. 1998 Feb 28;351(9103):637-41 [PMID: 9500320]
  19. Anaesthesist. 2012 Jun;61(6):537-42 [PMID: 22695775]
  20. PLoS One. 2012;7(5):e36624 [PMID: 22629319]
  21. Proc Biol Sci. 2014 Mar 26;281(1783):20133166 [PMID: 24671972]
  22. JAMA. 1990 Mar 9;263(10):1385-9 [PMID: 2406472]
  23. Annu Rev Virol. 2019 Sep 29;6(1):585-600 [PMID: 30986133]
  24. Proc Natl Acad Sci U S A. 2019 Jan 2;116(1):106-115 [PMID: 30530688]
  25. Biol Lett. 2020 Feb;16(2):20200062 [PMID: 32072862]
  26. PLoS One. 2020 Dec 8;15(12):e0243123 [PMID: 33290420]
  27. Physica A. 2020 Dec 1;559:125090 [PMID: 32834438]
  28. Perspect Psychol Sci. 2012 Nov;7(6):670-88 [PMID: 26168129]
  29. PLoS One. 2009 May 29;4(5):e5738 [PMID: 19478950]
  30. Proc Biol Sci. 2016 Sep 14;283(1838): [PMID: 27605504]

Word Cloud

Created with Highcharts 10.0.0LawtestsdataBenford'sacademicresearchapproachmanipulationusingadvicemisconductBenford���sIntegritytrustintegrityfundamentalHoweverproceduresmonitoringtrustworthinessinvestigatingcasesconcernpossiblefraudraisedwellestablishedsuggestpracticalinvestigationworksuspectedfraudulentvalueindividualpeer-reviewersinstitutionsjournalsdrawinspirationwell-establishedpracticesfinancialauditingprovidesynthesisliteratureadherenceculminatingsingleinitialtestdigitspositionnumericalstringswithindatasetalsorecommendmayproveusefuleventspecifichypothesesregardingnaturecanjustifiedImportantlydifferscommoncurrentimplementationsFurthermoreapplypreviously-publishedhighlightingefficacydetectingknownirregularitiesFinallydiscussresultsreferencestrengthslimitationsInvestigatingpreventingscientificAnimalbehaviourPeerreviewRetractedarticletestingScientific

Similar Articles

Cited By