The epidemiology of errors in data capture, management, and analysis: A scoping review of retracted articles and retraction notices in clinical and translational research.

Abigail S Baldridge, Grace C Bellinger, Oriana M Fleming, Luke V Rasmussen, Eric W Whitley, Leah J Welty
Author Information
  1. Abigail S Baldridge: Feinberg School of Medicine, Northwestern University, Chicago, IL, USA. ORCID
  2. Grace C Bellinger: Feinberg School of Medicine, Northwestern University, Chicago, IL, USA. ORCID
  3. Oriana M Fleming: Feinberg School of Medicine, Northwestern University, Chicago, IL, USA.
  4. Luke V Rasmussen: Feinberg School of Medicine, Northwestern University, Chicago, IL, USA. ORCID
  5. Eric W Whitley: Feinberg School of Medicine, Northwestern University, Chicago, IL, USA.
  6. Leah J Welty: Feinberg School of Medicine, Northwestern University, Chicago, IL, USA. ORCID

Abstract

Introduction: To better understand and prevent research errors, we conducted a first-of-its-kind scoping review of clinical and translational research articles that were retracted because of problems in data capture, management, and/or analysis.
Methods: The scoping review followed a preregistered protocol and used retraction notices from the Retraction Watch Database in relevant subject areas, excluding gross misconduct. Abstracts of original articles published between January 1, 2011 and January 31, 2020 were reviewed to determine if articles were related to clinical and translational research. We reviewed retraction notices and associated full texts to obtain information on who retracted the article, types of errors, authors, data types, study design, software, and data availability.
Results: After reviewing 1,266 abstracts, we reviewed 884 associated retraction notices and 786 full-text articles. Authors initiated the retraction over half the time (58%). Nearly half of retraction notices (42%) described problems generating or acquiring data, and 28% described problems with preparing or analyzing data. Among the full texts that we reviewed: 77% were human research; 29% were animal research; and 6% were systematic reviews or meta-analyses. Most articles collected data (77%), but only 5% described the methods used for data capture and management, and only 11% described data availability. Over one-third of articles (38%) did not specify the statistical software used.
Conclusions: Authors may improve scientific research by reporting methods for data capture and statistical software. Journals, editors, and reviewers should advocate for this documentation. Journals may help the scientific record self-correct by requiring detailed, transparent retraction notices.

Keywords

References

  1. J Int Soc Prev Community Dent. 2015 Jan-Feb;5(1):19-23 [PMID: 25767762]
  2. Sci Eng Ethics. 2018 Feb;24(1):189-206 [PMID: 28321689]
  3. J Blood Med. 2018 Oct 03;9:163-169 [PMID: 30323700]
  4. Nat Biotechnol. 2020 Mar;38(3):374 [PMID: 32066957]
  5. Sports (Basel). 2020 Feb 18;8(2): [PMID: 32085640]
  6. Nature. 2011 Oct 05;478(7367):26-8 [PMID: 21979026]
  7. Am J Obstet Gynecol MFM. 2020 Nov;2(4):100201 [PMID: 33345918]
  8. J Surg Res. 2019 Dec;244:612 [PMID: 31655761]
  9. J Biomed Inform. 2009 Apr;42(2):377-81 [PMID: 18929686]
  10. EMBO J. 2015 Oct 14;34(20):2483-5 [PMID: 26467018]
  11. World Neurosurg. 2017 Jul;103:809-814.e1 [PMID: 28412480]
  12. J Med Ethics. 2011 Sep;37(9):567-70 [PMID: 21486985]
  13. Int J Cardiol. 2022 Feb 15;349:109-114 [PMID: 34921899]
  14. Proc Natl Acad Sci U S A. 2022 Jun 21;119(25):e2119086119 [PMID: 35700358]
  15. JAMA Netw Open. 2022 Oct 3;5(10):e2234585 [PMID: 36194415]
  16. JAMA. 2018 Dec 11;320(22):2335-2343 [PMID: 30419103]
  17. PLoS One. 2020 Feb 13;15(2):e0229392 [PMID: 32053704]
  18. Metabolites. 2022 Jan 17;12(1): [PMID: 35050209]
  19. JAMA Intern Med. 2016 Nov 1;176(11):1726-1727 [PMID: 27723859]
  20. F1000Res. 2020 Oct 19;9:1257 [PMID: 33500780]
  21. Paediatr Perinat Epidemiol. 2017 Jun 15;: [PMID: 28617973]
  22. Traffic Inj Prev. 2020;21(2):179 [PMID: 32078384]
  23. JAMA. 2017 Sep 5;318(9):804-805 [PMID: 28873144]
  24. Lancet. 2009 Dec 5;374(9705):1876-7 [PMID: 19962558]
  25. PLoS One. 2018 Sep 20;13(9):e0204676 [PMID: 30235345]
  26. Med Oncol. 2015 Aug;32(8):221 [PMID: 26195291]
  27. Heart. 2013 Jun;99(11):820 [PMID: 23640983]
  28. JAMA Intern Med. 2021 Aug 1;181(8):1118-1121 [PMID: 33970185]
  29. Curr Med Res Opin. 2012 Oct;28(10):1575-83 [PMID: 22978774]
  30. JAMIA Open. 2020 Nov 06;3(3):342-358 [PMID: 33215069]
  31. BMC Res Notes. 2017 Jul 6;10(1):253 [PMID: 28683764]
  32. Am J Surg. 2018 Nov;216(5):851-855 [PMID: 29229380]
  33. JAMA. 1998 Jul 15;280(3):296-7 [PMID: 9676689]
  34. Syst Rev. 2021 Mar 29;10(1):89 [PMID: 33781348]
  35. Metabolites. 2019 Mar 05;9(3): [PMID: 30841575]
  36. Clin Nephrol. 2019 Mar 5;: [PMID: 30834887]
  37. JAMA Netw Open. 2023 Jun 1;6(6):e2320796 [PMID: 37378978]
  38. Eur J Prev Cardiol. 2019 May;26(7):783 [PMID: 30973025]
  39. PLoS One. 2012;7(10):e44118 [PMID: 23115617]
  40. Future Oncol. 2019 Nov;15(31):3597-3608 [PMID: 31659916]
  41. JAMA Pediatr. 2019 May 1;173(5):500-501 [PMID: 30882876]
  42. Int J Nurs Stud. 2018 May;81:8-13 [PMID: 29425913]
  43. Psychol Sci. 2016 Mar;27(3):432 [PMID: 26842315]
  44. J Clin Endocrinol Metab. 2019 Aug 1;104(8):W4-W14 [PMID: 31112273]
  45. Am J Respir Cell Mol Biol. 2019 Jan;60(1):134 [PMID: 30592444]
  46. Psychon Bull Rev. 2014 Apr;21(2):557-61 [PMID: 23975542]
  47. Pharmacotherapy. 2012 Jul;32(7):586-95 [PMID: 22581659]
  48. Cell Biol Int. 2016 Mar;40(3):361 [PMID: 26909548]
  49. Med J Aust. 2006 Aug 7;185(3):152-4 [PMID: 16893357]
  50. Hematol Oncol. 2017 Mar;35(1):142 [PMID: 28297104]
  51. Neurosci Lett. 2012 Jun 28;: [PMID: 22750151]
  52. BMC Genomics. 2016 Sep 08;17(1):721 [PMID: 27608804]
  53. PLoS One. 2019 Nov 14;14(11):e0225491 [PMID: 31725803]
  54. Biomed Eng Online. 2020 Jan 24;19(1):6 [PMID: 31973750]
  55. Proc Natl Acad Sci U S A. 2012 Oct 16;109(42):17028-33 [PMID: 23027971]
  56. Chem Commun (Camb). 2019 Oct 24;55(86):13016 [PMID: 31612871]
  57. J Clin Endocrinol Metab. 2019 Aug 1;104(8):3524 [PMID: 31241744]
  58. Nature. 2016 Mar 24;531(7595):415 [PMID: 27008933]
  59. J Clin Invest. 2023 Aug 15;133(16): [PMID: 37581309]
  60. Expert Rev Clin Immunol. 2020 Feb;16(2):229 [PMID: 31868040]
  61. AJR Am J Roentgenol. 2016 Feb;206(2):231-5 [PMID: 26797347]
  62. Clin Oral Investig. 2012 Oct;16(5):1511 [PMID: 22130862]
  63. Perfusion. 2017 Nov;32(8):NP2-NP9 [PMID: 25564508]
  64. J Health Soc Behav. 2015 Mar;56(1):59-73 [PMID: 25722125]
  65. Account Res. 2023 Dec;30(7):393-406 [PMID: 34856823]
  66. J Am Coll Cardiol. 2013 Apr 23;61(16):1751 [PMID: 23729038]
  67. Clin Trials. 2022 Aug;19(4):452-463 [PMID: 35730910]
  68. PLoS One. 2017 Jul 12;12(7):e0181509 [PMID: 28704528]
  69. Res Integr Peer Rev. 2017 May 12;2:5 [PMID: 29451549]

Word Cloud

Created with Highcharts 10.0.0dataresearcharticlesretractionnoticesscopingreviewtranslationalcapturemanagementdescribederrorsclinicalretractedproblemsusedreviewedsoftwareanalysisJanuary1associatedfulltextstypesavailabilityAuthorshalf77%methodsstatisticalmayscientificJournalsIntroduction:betterunderstandpreventconductedfirst-of-its-kindand/orMethods:followedpreregisteredprotocolRetractionWatchDatabaserelevantsubjectareasexcludinggrossmisconductAbstractsoriginalpublished2011312020determinerelatedobtaininformationarticleauthorsstudydesignResults:reviewing266abstracts884786full-textinitiatedtime58%Nearly42%generatingacquiring28%preparinganalyzingAmongreviewed:human29%animal6%systematicreviewsmeta-analysescollected5%11%one-third38%specifyConclusions:improvereportingeditorsreviewersadvocatedocumentationhelprecordself-correctrequiringdetailedtransparentepidemiologyanalysis:Clinicalretractions

Similar Articles

Cited By