Context Analysis of Continued Citation of Retracted Manuscripts Published in Anesthesiology Journals.

Peter E Frasco, Bradford B Smith, Andrew W Murray, Narjeet Khurmi, Jeff T Mueller, Karl A Poterack
Author Information
  1. Peter E Frasco: From the Department of Anesthesiology, Mayo Clinic Arizona, Phoenix, Arizona.

Abstract

The continued citation of retracted publications from the medical literature is a well-known and persistent problem. We describe the contexts of ongoing citations to manuscripts that have been retracted from a selection of anesthesiology journals. We also examine how bibliographic databases and publisher websites document the retracted status of these manuscripts. The authors performed an analysis of retracted publications from anesthesiology journals using the Retraction Watch database. We then examined how the retraction information was displayed on bibliographic databases, search engines, and publisher websites. The primary outcome was the context of continued citation after retraction of flawed publications within the specialty of anesthesiology. Secondary outcomes included comparison of the documentation, bibliographic databases, search engines, and publisher websites used in identifying the retracted status of these publications and provision of access to the respective retraction notices. A total of 245 original publications were retracted over a 28-year period from 9 anesthesiology journals. PubMed, compared to the other databases and search engines, was the most consistent (98.8%) in documenting the retracted status of the publications examined, as well as providing a direct link to the retraction notice. From the 211 publications retracted before January 2020, there were 1307 postretraction citations accessed from Scopus. The median number of postretraction citations was 3.5 (range, 0-88, with at least 1 citation in 164 publications) in Scopus. Of the postretraction citations, 80% affirmed the validity of the retracted publications, while only 5.2% of citations acknowledged the retraction or misconduct. In 10.2% of the citations from original research studies, retracted manuscripts appeared to influence the decision to pursue or the methods used in subsequent original research studies. The frequency of citation of the 15 most cited retracted publications declined in a similar pattern during the 10 years after retraction. Citation of manuscripts retracted from anesthesiology journals remains a common occurrence. Technological innovations and application of standards for handling retracted publications, as suggested by coalitions of researchers across the spectrum of scientific investigation, may serve to reduce the persistence of this error.

References

  1. Zombie research haunts academic literature long after its supposed demise. The Economist. 2021. June 26, 2021.
  2. Collier R. Shedding light on retractions. CMAJ. 2010;183:E385–E386.
  3. Grieneisen ML, Zhang M. A comprehensive survey of retracted articles from the scholarly literature. PLoS One. 2012;7:e44118.
  4. Zhang MH, Grieneisen ML. The impact of misconduct on the published medical and non-medical literature, and the news media. Scientometrics. 2013;96:573–587.
  5. Kharasch ED. Scientific integrity and misconduct-yet again. Anesthesiology. 2021;135:377–379.
  6. Bornemann-Cimenti H, Szilagyi IS, Sandner-Kiesling A. Perpetuation of retracted publications using the example of the Scott S. Reuben case: incidences, reasons and possible improvements. Sci Eng Ethics. 2016;22:1063–1072.
  7. Nair S, Yean C, Yoo J, Leff J, Delphin E, Adams DC. Reasons for article retraction in anesthesiology: a comprehensive analysis. Can J Anaesth. 2020;67:57–63.
  8. Kharasch ED, Houle TT. Seeking and reporting apparent research misconduct: errors and integrity. Anaesthesia. 2018;73:125–126.
  9. Rosenkrantz AB. Retracted publications within radiology journals. AJR Am J Roentgenol. 2016;206:231–235.
  10. Shafer SL. Shadow of doubt. Anesth Analg. 2011;112:498–500.
  11. Thomasson P, Stanley JC. Uncritical citation of criticized data. Science. 1955;121:610–611.
  12. Woolf P. Fraud in science: how much, how serious? Hastings Cent Rep. 1981;11:9–14.
  13. Garfield E, Welljams-Dorof A. The impact of fraudulent research on the scientific literature. The Stephen E. Breuning case. JAMA. 1990;263:1424–1426.
  14. Budd JM, Sievert M, Schultz TR. Phenomena of retraction: reasons for retraction and citations to the publications. JAMA. 1998;280:296–297.
  15. Wang Y, Attar BM, Hinami K, et al. Characteristics and impacts of venous thromboembolism in patients with hepatocellular carcinoma. J Gastrointest Cancer. 2018;49:275–282.
  16. Bennett C, Chambers LM, Al-Hafez L, et al. Retracted articles in the obstetrics literature: lessons from the past to change the future. Am J Obstet Gynecol MFM. 2020;2:100201.
  17. Xian Y, Xu H, O’Brien EC, et al. Clinical effectiveness of direct oral anticoagulants vs warfarin in older patients with atrial fibrillation and ischemic stroke: findings from the Patient-Centered Research Into Outcomes Stroke Patients Prefer and Effectiveness Research (PROSPER) study. JAMA Neurol. 2019;76(10):1192–1102.
  18. Neale AV, Dailey RK, Abrams J. Analysis of citations to biomedical articles affected by scientific misconduct. Sci Eng Ethics. 2010;16:251–261.
  19. Bolland MJ, Grey A, Avenell A. Citation of retracted publications: a challenging problem. Account Res. 2021;29:1–8.
  20. Agarwal S, Choubey L, Yu H. Automatically classifying the role of citations in biomedical articles. AMIA Annu Symp Proc. 2010:11–15.
  21. Bar-Ilan J, Halevi G. Post retraction citations in context: a case study. Scientometrics. 2017;113:547–565.
  22. Suelzer EM, Deal J, Hanus K, Ruggeri BE, Witkowski E. Challenges in identifying the retracted status of an article. JAMA Netw Open. 2021;4:e2115648.
  23. Szilagyi IS, Schittek GA, Klivinyi C, et al. Citation of retracted research: a case-controlled, ten-year follow-up scientometric analysis of Scott S. Reuben’s malpractice. Scientometrics. 2022;127:2611–2620.
  24. Furman JJ, Jensen K, Murray F. Governing knowledge in the scientific community: exploring the role of retractions in biomedicine. Res Policy. 2012;41:276–290.
  25. Hsiao TK, Schneider J. Continued use of retracted papers: temporal trends in citations and (lack of) awareness of retractions shown in citation contexts in biomedicine. Quant Sci Stud. 2022;4:1144–1169.
  26. Theis-Mahon NR, Bakker CJ. The continued citation of retracted publications in dentistry. J Med Libr Assoc. 2020;108:389–397.
  27. Hesselmann F, Graf V, Schmidt M, Reinhart M. The visibility of scientific misconduct: a review of the literature on retracted journal articles. Curr Sociol. 2017;65:814–845.
  28. Greitemeyer T. Article retracted, but the message lives on. Psychon Bull Rev. 2014;21:557–561.
  29. Fanelli D, Wong J, Moher D. What difference might retractions make? An estimate of the potential epistemic cost of retractions on meta-analyses. Account Res. 2021;29(70):442–459.
  30. Teixeira da Silva JA, Dobranszki J. Notices and policies for retractions, expressions of concern, errata and corrigenda: their importance, content, and context. Sci Eng Ethics. 2017;23:521–554.
  31. Schneider J, Ye D, Hill AM, et al. Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data. Scientometrics. 2020;125:2877–2913.
  32. Moylan EC, Kowalczuk MK. Why articles are retracted: a retrospective cross-sectional study of retraction notices at BioMed Central. BMJ Open. 2016;6:e012047.
  33. King EG, Oransky I, Sachs TE, et al. Analysis of retracted articles in the surgical literature. Am J Surg. 2018;216:851–855.
  34. Office of Research Integrity (2001–2010) Annual Reports. Office of Research Integrity Newsletter. 2012;21(1):1–15. Accessed May 2, 2022. http://ori.hhs.gov/annual_reports .
  35. Fang FC, Steen RG, Casadevall A. Misconduct accounts for the majority of retracted scientific publications. Proc Natl Acad Sci U S A. 2012;109:17028–17033.
  36. Cosentino AM, Veríssimo D. Ending the citation of retracted papers. Conserv Biol. 2016;30:676–678.
  37. Eisenach JC. Data fabrication and article retraction: how not to get lost in the woods. Anesthesiology. 2009;110:955–956.
  38. Editors ICoMJ. Recommendations for the Conduct, Reporting, Editing and Publication of Scholarly Work in Medical Journals. 2021. Accessed April 10, 2022. http://www.icmje.org/recommendations .
  39. COPE C. COPE Retraction Guidelines. 2019. Accessed March 18, 2022. https://publicationethics.org/retraction-guidelines .
  40. Davis PM. The persistence of error: a study of retracted articles on the Internet and in personal libraries. J Med Libr Assoc. 2012;100:184–189.
  41. Reducing the Inadvertent Spread of Retracted Science: Shaping a Research and Implementation Agenda. 2020. Accessed March 2, 2022. https://infoqualitylab.org/projects/risrs2020 .
  42. Szarek M, White HD, Schwartz GG, et al.; ODYSSEY OUTCOMES Committees and Investigators. Alirocumab reduces total nonfatal cardiovascular and fatal events: the ODYSSEY OUTCOMES trial. J Am Coll Cardiol. 2019;73:387–396.
  43. Fang FC, Steen RG, Casadevall A. Misconduct accounts for the majority of retracted scientific publications (vol 109, pg 17028, 2012). P Natl Acad Sci USA. 2013;110:1137.
  44. Sox HC, Rennie D. Research misconduct, retraction, and cleansing the medical literature: lessons from the Poehlman case. Ann Intern Med. 2006;144:609–613.
  45. Karger publishers and Scite launch automated reference check pilot. 2021. Accessed January 29, 2022. medium.com/scite/karger-publishers-and-scite-launch-automated-reference-check-pilot-c027735407d .

MeSH Term

Anesthesiology
Periodicals as Topic
Publications
Bibliometrics
Databases, Bibliographic
Scientific Misconduct

Word Cloud

Created with Highcharts 10.0.0retractedpublicationscitationsretractionanesthesiologycitationmanuscriptsjournalsdatabasesbibliographicpublisherwebsitesstatussearchenginesoriginalpostretractioncontinuedexaminedusedScopus52%10researchstudiesCitationmedicalliteraturewell-knownpersistentproblemdescribecontextsongoingselectionalsoexaminedocumentauthorsperformedanalysisusingRetractionWatchdatabaseinformationdisplayedprimaryoutcomecontextflawedwithinspecialtySecondaryoutcomesincludedcomparisondocumentationidentifyingprovisionaccessrespectivenoticestotal24528-yearperiod9PubMedcomparedconsistent988%documentingwellprovidingdirectlinknotice211January20201307accessedmediannumber3range0-88least116480%affirmedvalidityacknowledgedmisconductappearedinfluencedecisionpursuemethodssubsequentfrequency15citeddeclinedsimilarpatternyearsremainscommonoccurrenceTechnologicalinnovationsapplicationstandardshandlingsuggestedcoalitionsresearchersacrossspectrumscientificinvestigationmayservereducepersistenceerrorContextAnalysisContinuedRetractedManuscriptsPublishedAnesthesiologyJournals

Similar Articles

Cited By