Misjudgment of Skills in Clinical Examination Increases in Medical Students Due to a Shift to Exclusively Online Studies during the COVID-19 Pandemic.

Axel Lechner, Stefan P Haider, Benedikt Paul, Pablo F F Escrihuela Branz, Axelle Felicio-Briegel, Magdalena Widmann, Johanna Huber, Ursula Stadlberger, Martin Canis, Florian Schrötzlmair, Kariem Sharaf
Author Information
  1. Axel Lechner: Department of Otolaryngology, University Hospital, LMU Munich, Marchioninistrasse 15, 81377 Munich, Germany.
  2. Stefan P Haider: Department of Otolaryngology, University Hospital, LMU Munich, Marchioninistrasse 15, 81377 Munich, Germany.
  3. Benedikt Paul: Department of Otolaryngology, University Hospital, LMU Munich, Marchioninistrasse 15, 81377 Munich, Germany.
  4. Pablo F F Escrihuela Branz: Department of Otolaryngology, University Hospital, LMU Munich, Marchioninistrasse 15, 81377 Munich, Germany.
  5. Axelle Felicio-Briegel: Department of Otolaryngology, University Hospital, LMU Munich, Marchioninistrasse 15, 81377 Munich, Germany.
  6. Magdalena Widmann: Department of Otolaryngology, University Hospital, LMU Munich, Marchioninistrasse 15, 81377 Munich, Germany.
  7. Johanna Huber: Institute for Medical Education, University Hospital, LMU Munich, Pettenkoferstrasse 8a, 80336 Munich, Germany.
  8. Ursula Stadlberger: Institute for Medical Education, University Hospital, LMU Munich, Pettenkoferstrasse 8a, 80336 Munich, Germany.
  9. Martin Canis: Department of Otolaryngology, University Hospital, LMU Munich, Marchioninistrasse 15, 81377 Munich, Germany.
  10. Florian Schrötzlmair: Department of Otolaryngology, University Hospital, LMU Munich, Marchioninistrasse 15, 81377 Munich, Germany.
  11. Kariem Sharaf: Department of Otolaryngology, University Hospital, LMU Munich, Marchioninistrasse 15, 81377 Munich, Germany. ORCID

Abstract

In medical school, practical capacity building is a central goal. During the COVID-19 pandemic, a shift to online teaching methods in university was mandated in many countries to reduce risk of SARS-CoV-2 transmission. This severely affected the teaching of psychomotor ability skills such as head and neck examination skills, resulting in a share of students that have only been taught such ENT-specific examination skills with online courses; our study aimed to measure performance and capacity of self-evaluation in these students. After completing a new extensive online Ear Nose Throat (ENT) examination course, we conducted a standardized clinical skills exam for nine different ENT examination items with 31 students. Using Likert scales, self-evaluation was based on questionnaires right before the clinical skills exam and objective evaluation during the exam was assessed following a standardized regime. Self-evaluation and objective evaluation were correlated. To compare the exclusive online teaching to traditional hands-on training, a historic cohort with 91 students was used. Objective examination performance after in-classroom or online teaching varied for single examination items while overall assessment remained comparable. Overall, self-evaluation did not differ significantly after online-only and in-classroom ENT skill teaching. Nevertheless, misjudgment of one's skill level increased after online-only training compared to in-classroom teaching. Highest levels of overestimation were observed after online training in simple tasks. While gender and interest in ENT did not influence self-evaluation and misjudgment, higher age of participants was associated with an overestimation of skills. Medical students with online-only training during the COVID-19 pandemic achieved similar ENT examination skills to those with traditional on-campus training before the pandemic. Nevertheless, students with online-only training were more prone to misjudge their skills when they assessed their skills. Due to the COVID-19 pandemic, current medical students and graduates might therefore lack individual specific psychomotor skills such as the ENT examination, underlining the importance of presence-based teaching.

Keywords

References

  1. HNO. 2020 Apr;68(4):238-247 [PMID: 32157337]
  2. J Emerg Trauma Shock. 2021 Jan-Mar;14(1):3-13 [PMID: 33911429]
  3. Otolaryngol Head Neck Surg. 2021 Mar;164(3):556-561 [PMID: 32779955]
  4. Ann Otol Rhinol Laryngol. 2020 Nov;129(11):1095-1100 [PMID: 32495632]
  5. HNO. 2022 Apr;70(4):295-303 [PMID: 34622305]
  6. Educ Prim Care. 2020 Nov;31(6):377-381 [PMID: 32842902]
  7. Urologe A. 2021 Apr;60(4):484-490 [PMID: 33433661]
  8. GMS J Med Educ. 2021 Jan 28;38(1):Doc6 [PMID: 33659611]
  9. Fortschr Neurol Psychiatr. 2021 Nov;89(11):573-577 [PMID: 33946123]
  10. J Pak Med Assoc. 2021 Jun;71(6):1535-1539 [PMID: 34111067]
  11. J Surg Educ. 2021 Jan-Feb;78(1):346-350 [PMID: 32654999]
  12. Med Educ Online. 2021 Dec;26(1):1919042 [PMID: 33871308]
  13. Future Healthc J. 2021 Mar;8(1):e50-e53 [PMID: 33791476]
  14. Otolaryngol Head Neck Surg. 2020 Oct;163(4):707-709 [PMID: 32515642]
  15. Med Sci Educ. 2021 Nov 12;32(1):221-228 [PMID: 34804635]
  16. Neurology. 2021 Nov 16;97(20):e2032-e2038 [PMID: 34556563]
  17. GMS J Med Educ. 2021 Jan 28;38(1):Doc5 [PMID: 33659610]
  18. GMS J Med Educ. 2020 Dec 03;37(7):Doc83 [PMID: 33364362]
  19. GMS J Med Educ. 2021 Nov 15;38(7):Doc117 [PMID: 34957322]
  20. BMC Med Educ. 2010 May 20;10:35 [PMID: 20487536]
  21. GMS J Med Educ. 2021 Jan 28;38(1):Doc2 [PMID: 33659607]
  22. Zentralbl Chir. 2021 Dec;146(6):586-596 [PMID: 34872114]
  23. BMC Med Educ. 2011 Nov 24;11:99 [PMID: 22114989]
  24. HNO. 2022 Apr;70(4):287-294 [PMID: 34545415]
  25. Acad Med. 2001 Oct;76(10 Suppl):S87-9 [PMID: 11597883]
  26. Teach Learn Med. 2021 Jun-Jul;33(3):334-342 [PMID: 33706632]
  27. Otolaryngol Head Neck Surg. 2021 Sep;165(3):385-386 [PMID: 33685290]
  28. GMS J Med Educ. 2020 Dec 03;37(7):Doc81 [PMID: 33364360]
  29. Otolaryngol Head Neck Surg. 2021 Mar;164(3):562-565 [PMID: 32957851]
  30. Ophthalmologe. 2022 Jan;119(Suppl 1):11-18 [PMID: 33825052]
  31. BMC Med Educ. 2021 Feb 27;21(1):137 [PMID: 33639906]
  32. GMS J Med Educ. 2020 Dec 03;37(7):Doc102 [PMID: 33364381]
  33. Patient Educ Couns. 2011 Jul;84(1):3-9 [PMID: 20708898]
  34. GMS J Med Educ. 2020 Dec 03;37(7):Doc82 [PMID: 33364361]
  35. GMS J Med Educ. 2020 Dec 03;37(7):Doc68 [PMID: 33364347]

Word Cloud

Created with Highcharts 10.0.0skillsteachingexaminationstudentsonlineENTtrainingCOVID-19pandemicself-evaluationonline-onlymedicalpsychomotorexamin-classroomcapacityabilityperformancestandardizedclinicalitemsobjectiveevaluationassessedtraditionalskillNeverthelessmisjudgmentoverestimationMedicalDueschoolpracticalbuildingcentralgoalshiftmethodsuniversitymandatedmanycountriesreduceriskSARS-CoV-2transmissionseverelyaffectedheadneckresultingsharetaughtENT-specificcoursesstudyaimedmeasurecompletingnewextensiveEarNoseThroatcourseconductedninedifferent31UsingLikertscalesbasedquestionnairesrightfollowingregimeSelf-evaluationcorrelatedcompareexclusivehands-onhistoriccohort91usedObjectivevariedsingleoverallassessmentremainedcomparableOveralldiffersignificantlyone'slevelincreasedcomparedHighestlevelsobservedsimpletasksgenderinterestinfluencehigherageparticipantsassociatedachievedsimilaron-campuspronemisjudgecurrentgraduatesmightthereforelackindividualspecificunderliningimportancepresence-basedMisjudgmentSkillsClinicalExaminationIncreasesStudentsShiftExclusivelyOnlineStudiesPandemiceducationotorhinolaryngology

Similar Articles

Cited By (1)