A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations.

Caspar Chorus, Ludo Waltman
Author Information
  1. Caspar Chorus: Department of Engineering Systems and Services, Delft University of Technology, Delft, The Netherlands. ORCID
  2. Ludo Waltman: Centre for Science and Technology Studies, Leiden University, Leiden, The Netherlands.

Abstract

Based on three decades of citation data from across scientific fields of science, we study trends in impact factor biased self-citations of scholarly journals, using a purpose-built and easy to use citation based measure. Our measure is given by the ratio between i) the relative share of journal self-citations to papers published in the last two years, and ii) the relative share of journal self-citations to papers published in preceding years. A ratio higher than one suggests that a journal's impact factor is disproportionally affected (inflated) by self-citations. Using recently reported survey data, we show that there is a relation between high values of our proposed measure and coercive journal self-citation malpractices. We use our measure to perform a large-scale analysis of impact factor biased journal self-citations. Our main empirical result is, that the share of journals for which our measure has a (very) high value has remained stable between the 1980s and the early 2000s, but has since risen strongly in all fields of science. This time span corresponds well with the growing obsession with the impact factor as a journal evaluation measure over the last decade. Taken together, this suggests a trend of increasingly pervasive journal self-citation malpractices, with all due unwanted consequences such as inflated perceived importance of journals and biased journal rankings.

References

  1. Arch Immunol Ther Exp (Warsz). 2008 Jul-Aug;56(4):223-6 [PMID: 18661263]
  2. PLoS One. 2016 Apr 18;11(4):e0153730 [PMID: 27088862]
  3. Nature. 1996 May 16;381(6579):186 [PMID: 8622752]
  4. PLoS Med. 2006 Jun;3(6):e291 [PMID: 16749869]
  5. Science. 2012 Feb 3;335(6068):542-3 [PMID: 22301307]
  6. Nature. 2013 Aug 29;500(7464):510-1 [PMID: 23985850]
  7. Nature. 2015 Apr 23;520(7548):429-31 [PMID: 25903611]
  8. Sci Eng Ethics. 2015 Apr;21(2):531-3 [PMID: 24728611]

MeSH Term

Bibliometrics
Biomedical Research
Journal Impact Factor
Malpractice
Publishing
Research Design
Science

Word Cloud

Created with Highcharts 10.0.0journalmeasureself-citationsimpactfactorbiasedjournalssharecitationdatafieldsscienceuseratiorelativepaperspublishedlastyearssuggestsinflatedhighself-citationmalpracticesBasedthreedecadesacrossscientificstudytrendsscholarlyusingpurpose-builteasybasedgiventwoiiprecedinghigheronejournal'sdisproportionallyaffectedUsingrecentlyreportedsurveyshowrelationvaluesproposedcoerciveperformlarge-scaleanalysismainempiricalresultvalueremainedstable1980searly2000ssincerisenstronglytimespancorrespondswellgrowingobsessionevaluationdecadeTakentogethertrendincreasinglypervasivedueunwantedconsequencesperceivedimportancerankingsLarge-ScaleAnalysisImpactFactorBiasedJournalSelf-Citations

Similar Articles

Cited By