Simulation-based assessment in the context of paramedic education: A scoping review.

Steve Bell
Author Information
  1. Steve Bell: North West Ambulance Service NHS Trust, Bolton, UK. ORCID

Abstract

OBJECTIVE: Simulation is a widespread modality in the field of medical education. Within the paramedic sphere, simulation is valuable in providing exposure to high-acuity, low occurrence incidents encountered rarely in practice, affording unique educational opportunities. Recognising this importance, this scoping review seeks to establish the contemporaneous evidence base for the use of simulation-based assessment in the context of paramedic education, systematically map the research done in this area and consider the implications for future educational programmes.
METHODS: A scoping review of peer, and non-peer reviewed literature across a broad range of medical literature databases for both published and grey material utilising previously published search filters for the paramedic field. The review was conducted aligned to the PRISMA Extension for Scoping Reviews checklist. Studies were selected based on relevance to the research question.
RESULTS: Twenty four unique papers were identified, filtered via the application of inclusion and exclusion criteria to five included papers. The application of forward snowballing methodology revealed three additional papers included for appraisal. Thematic analysis of the eight papers revealed the domains of assessment acceptability and assessment validity as key considerations for the design and use of simulation-based assessment in the field.
CONCLUSION: Simulation-based assessment has a role in paramedic education; additional research is necessary to empirically establish the validity and reliability of the modality in the field.

References

  1. Morton J, Kloepping K, Buick J, Todd J, Batt A. The evolution of the paramedic. Can J Paramed. 2015;38:22���25.
  2. Clarke V, Rollason A, Tune R. The role of the practice educator: assessor. In: Clarke V, editorA handbook for practice educators and facilitators Bridgewater: College of Paramedics; 2020. p. 75���90.
  3. Elmore R. The future of learning and the future of assessment. ECNU Rev Educ. 2019;2(3):328���341. https://doi.org/10.1177/2096531119878962
  4. So HY, Chen PP, Wong GKC, Chan TTN. Simulation in medical education. J Royal Col Phys Edinburgh. 2019;49(1):52���57. https://doi.org/10.4997/JRCPE.2019.112
  5. Cook D, Hatala R, Brydges R, Zendejas B, Szostek J, Wang A, et al. Technology���enhanced simulation for health professions education: a systematic review and meta���analysis. JAMA. 2011;306(9):978���988. https://doi.org/10.1001/jama.2011.1234
  6. Wheeler B, Dippenaar E. The use of simulation as a teaching modality for paramedic education: a scoping review. Brit Paramed J. 2020;5(3):31���43. https://doi.org/10.29045/14784726.2020.12.5.3.31
  7. Mancera M, Genthe N, Gussick M, Lohmeier M, Thompson R, Shah M. Acceptability and preferences of simulation���based continuing education among emergency medical service providers. WMJ. 2022;121(2):127���131. PMID: 35857688.
  8. Bearman M, Nestel D, McNaughton N. Theoretical perspectives and frameworks for healthcare simulation. In: Nestel D, Kell M, Jolly B, Watson M, editorsHealthcare simulation education: evidence, theory and practice Chichester: John Wiley & Sons; 2017 Available at: http://ebookcentral.proquest.com/lib/edgehill/detail.action?docID=4825789
  9. Mislevy R. Evidence���centered design for simulation���based assessment. Mil Med. 2013;178(10):107���114. https://doi.org/10.7205/MILMED-D-13-00213
  10. Baker E, Niemi D, Chung G. Simulations and the transfer of problem���solving knowledge and skills. In: Baker E, Dickieson J, Wulfeck W, O'neil H, editorsAssessment of problem���solving using simulations New York: Routledge; 2011.
  11. Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 2015;13(3):141���146. https://doi.org/10.1097/XEB.0000000000000050
  12. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA���ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467���473. https://doi.org/10.7326/M18-0850
  13. Library and Knowledge Service for NHS Ambulance Services in England. 2020. Search filters for prehospital care, paramedicine and emergency medical dispatch [online]. Available from: https://ambulance.libguides.com/searchfilter/paramedicine
  14. Lammers R, Byrwa M, Fales D, Hale R. Simulation���based assessment of paramedic pediatric resuscitation skills. Prehosp Emerg Care. 2009;13:345���356. https://doi.org/10.1080/10903120802706161
  15. Smith A, Andersen P. Simulation���based assessment facilitates learning & enhances clinical judgment. J Emerg Med Serv. 2014. [online]. https://www.jems.com/training/simulation-based-assessment-facilitates/
  16. Tavares W, Leblanc V, Mausz J, Sun V, Eva K. Simulation���based assessment of paramedics and performance in real clinical contexts. Prehosp Emerg Care. 2014;18(1):116���122. https://doi.org/10.3109/10903127.2013.818178
  17. Tavares W, Boet S. On the assessment of paramedic competence: a narrative review with practice implications. Prehosp Disaster Med. 2015;31(1):64���73. https://doi.org/10.1017/S1049023X15005166
  18. Campbell R, Labuschagne M, Bezuidenhout J. Perspectives of advanced life support paramedics on clinical simulation for summative assessment in South Africa: is it time for change? Afr J Health Prof Educ. 2018;10(3):183. https://doi.org/10.7196/AJHPE.2018.v10i3.962
  19. Tavares W, Brydges R, Myre P, Prpic J, Turner L, Yelle R, et al. Applying Kane's validity framework to a simulation���based assessment of clinical competence. Adv Health Sci Educ. 2018;23(2):323���338. https://doi.org/10.1007/s10459-017-9800-3
  20. Diamond A, Bilton N. The current state on the use of simulation in paramedic education. Austr J Paramed. 2021;4(18):1���5. https://doi.org/10.33151/ajp.18.903
  21. Gugiu M, Cash R, Rivard M, Cotto J, Crowe R, Panchal A. Development and validation of content domains for paramedic prehospital performance assessment: a focus group and Delphi method approach. Prehosp Emerg Care. 2021;25(2):196���204. https://doi.org/10.1080/10903127.2020.1750743
  22. Leggio W, Cummins N. The importance of research for paramedicine as a profession. In: Olaussen A, Bowles KA, Lord B, Williams B, editors. Introducing, designing and conducting research for paramedics Chatswood: Elsevier; 2022.
  23. Cook D, Hatala R. Validation of educational assessments: a primer for simulation and beyond. Adv Simul. 2016;1(31):31. https://doi.org/10.1186/s41077-016-0033-y
  24. Kane M. Validating the interpretations and uses of test scores. J Educ Meas. 2013;50(1):1���73. https://doi.org/10.1111/jedm.12000
  25. Newton P, Shaw S. Validity in educational & psychological assessment. London: SAGE; 2014. https://doi.org/10.4135/9781446288856
  26. Harden R, Laidlaw J. Essential skills for a medical teacher: an Introduction to teaching and learning in medicine 3rd ed. New York: Elsevier; 2020. Available at: https://ebookcentral.proquest.com/lib/edgehill/reader.action?docID=6229006&ppg=237
  27. Ryall T, Judd B, Gordon C. Simulation���based assessments in health professional education: a systematic review. J Multidiscip Healthc. 2016;22(9):69���82. https://doi.org/10.2147/JMDH.S92695

MeSH Term

Humans
Allied Health Personnel
Clinical Competence
Educational Measurement
Paramedics
Simulation Training

Word Cloud

Created with Highcharts 10.0.0assessmentparamedicfieldreviewpaperseducationscopingresearchmodalitymedicaluniqueeducationalestablishusesimulation-basedcontextliteraturepublishedapplicationincludedrevealedadditionalvaliditySimulation-basedOBJECTIVE:SimulationwidespreadWithinspheresimulationvaluableprovidingexposurehigh-acuitylowoccurrenceincidentsencounteredrarelypracticeaffordingopportunitiesRecognisingimportanceseekscontemporaneousevidencebasesystematicallymapdoneareaconsiderimplicationsfutureprogrammesMETHODS:peernon-peerreviewedacrossbroadrangedatabasesgreymaterialutilisingpreviouslysearchfiltersconductedalignedPRISMAExtensionScopingReviewschecklistStudiesselectedbasedrelevancequestionRESULTS:TwentyfouridentifiedfilteredviainclusionexclusioncriteriafiveforwardsnowballingmethodologythreeappraisalThematicanalysiseightdomainsacceptabilitykeyconsiderationsdesignCONCLUSION:rolenecessaryempiricallyreliabilityeducation:

Similar Articles

Cited By