Evaluating the adoption of handsearching, citation chasing, and screening tools in education research: a survey study.

Qiyang Zhang, Marta Pellegrini, Francesco Marsili, Amanda Neitzel
Author Information
  1. Qiyang Zhang: Johns Hopkins University, Baltimore, MD, United States.
  2. Marta Pellegrini: Department of Pedagogy, Psychology, Philosophy, University of Cagliari, Cagliari, Italy.
  3. Francesco Marsili: Department of Philosophy, Social and Human Sciences and Education, University of Perugia, Perugia, Umbria, Italy.
  4. Amanda Neitzel: School of Education, Johns Hopkins University, Baltimore, MD, United States.

Abstract

Introduction: The rapid development of software tools to assist systematic reviewers has led to varying degrees of adoption and selection among researchers. However, the actual usage patterns of these tools, their preferred features, and the criteria for selecting the most suitable tools remain unclear.
Methods: To understand these aspects, we collected 175 responses from researchers across different continents.
Results: In terms of handsearching, despite new tools developed, our findings reveal that manual handsearching remains prevalent among more than half of the participants. Databases are the most popular tools for citation searching, followed by citation management tools and spreadsheets. This reliance on citation management tools and spreadsheets is concerning as they are not specifically designed for systematic reviews. The primary factors influencing tool selection are the research environment and ease of use. Barriers stopping researchers from adopting alternative tools include limited awareness, challenges in learning new tools, and the financial costs associated with acquiring licenses. Moreover, researchers located in Europe show greater familiarity with a wider range of tools compared to their North American counterparts.
Discussion: This preregistered study contributes valuable insights into the tool usage patterns of education researchers, emphasizing the importance of promoting awareness and facilitating the broader adoption of existing tools.

Keywords

References

  1. PLoS One. 2020 Jan 14;15(1):e0227742 [PMID: 31935267]
  2. Syst Rev. 2021 Apr 1;10(1):93 [PMID: 33795003]
  3. Syst Rev. 2021 Mar 29;10(1):89 [PMID: 33781348]
  4. J Clin Epidemiol. 2020 May;121:81-90 [PMID: 32004673]
  5. Res Synth Methods. 2017 Sep;8(3):275-280 [PMID: 28374510]
  6. J Clin Epidemiol. 2022 Sep;149:53-59 [PMID: 35654270]
  7. Syst Rev. 2016 Dec 5;5(1):210 [PMID: 27919275]
  8. Syst Rev. 2019 Nov 15;8(1):278 [PMID: 31727150]
  9. Res Synth Methods. 2023 Mar;14(2):323-335 [PMID: 36260090]
  10. BMJ Open. 2017 Feb 27;7(2):e012545 [PMID: 28242767]
  11. Nurse Educ Today. 2017 Sep;56:29-34 [PMID: 28651100]
  12. ALTEX. 2019 May 16;36(3):508-517 [PMID: 31113000]
  13. Res Synth Methods. 2022 May;13(3):353-362 [PMID: 35174972]
  14. Res Synth Methods. 2022 Jul;13(4):533-545 [PMID: 35472127]
  15. BMC Med Res Methodol. 2015 Oct 13;15:84 [PMID: 26462491]
  16. Perspect Psychol Sci. 2020 Jul;15(4):1026-1041 [PMID: 32516081]
  17. BMC Med Res Methodol. 2018 Aug 14;18(1):85 [PMID: 30107788]
  18. BMC Med Res Methodol. 2020 Jan 13;20(1):7 [PMID: 31931747]

Word Cloud

Created with Highcharts 10.0.0toolsresearcherscitationhandsearchingsystematicadoptioneducationselectionamongusagepatternsnewsearchingmanagementspreadsheetsreviewstoolawarenessstudyscreeningsurveyIntroduction:rapiddevelopmentsoftwareassistreviewersledvaryingdegreesHoweveractualpreferredfeaturescriteriaselectingsuitableremainunclearMethods:understandaspectscollected175responsesacrossdifferentcontinentsResults:termsdespitedevelopedfindingsrevealmanualremainsprevalenthalfparticipantsDatabasespopularfollowedrelianceconcerningspecificallydesignedprimaryfactorsinfluencingresearchenvironmenteaseuseBarriersstoppingadoptingalternativeincludelimitedchallengeslearningfinancialcostsassociatedacquiringlicensesMoreoverlocatedEuropeshowgreaterfamiliaritywiderrangecomparedNorthAmericancounterpartsDiscussion:preregisteredcontributesvaluableinsightsemphasizingimportancepromotingfacilitatingbroaderexistingEvaluatingchasingresearch:meta-analysis

Similar Articles

Cited By