Integrating behavioral assessment in instructional design for competency-based medical education.

K N Williams, Elizabeth H Lazzara, M Sadighi, N Chandran, K Joshi, S Raj, I Shields, B Nichols, D Testa, J Hernandez, M Michael, R Rege, P Greilich
Author Information
  1. K N Williams: Department of Human Factors and Behavioral Neurobiology, Embry-Riddle Aeronautical University, Daytona Beach, FL, United States.
  2. Elizabeth H Lazzara: Department of Human Factors and Behavioral Neurobiology, Embry-Riddle Aeronautical University, Daytona Beach, FL, United States.
  3. M Sadighi: Office of Undergraduate Medical Education, UT Southwestern Medical Center, Dallas, TX, United States.
  4. N Chandran: Department of Anesthesiology and Pain Management, UT Southwestern Medical Center, Dallas, TX, United States.
  5. K Joshi: Department of Emergency Medicine, UT Southwestern Medical Center, Dallas, TX, United States.
  6. S Raj: Department of Emergency Medicine, UT Southwestern Medical Center, Dallas, TX, United States.
  7. I Shields: Department of Anesthesiology and Critical Care, Penn Medicine, Philadelphia, PA, United States.
  8. B Nichols: Department of Pediatrics, UT Southwestern Medical Center, Dallas, TX, United States.
  9. D Testa: Department of Emergency Medicine, UT Southwestern Medical Center, Dallas, TX, United States.
  10. J Hernandez: Department of Emergency Medicine, UT Southwestern Medical Center, Dallas, TX, United States.
  11. M Michael: Department of Anesthesiology and Pain Management, UT Southwestern Medical Center, Dallas, TX, United States.
  12. R Rege: Department of Surgery, Office of Undergraduate Medical Education, UT Southwestern Medical Center, Dallas, TX, United States.
  13. P Greilich: Department of Anesthesiology and Pain Management, Office of Undergraduate Medical Education, Health System Chief Quality Office, UT Southwestern Medical Center, Dallas, TX, United States.

Abstract

As institutions continuously strive to align with the standards set forth within competency-based medical education, there is an increased need to produce evidence of learner achievement in the form of observable behaviors. However, the complexity of healthcare education and clinical environments make it challenging to generate valid and reliable behavioral assessments. In this article, we utilize our interdisciplinary knowledge from the perspectives of experts in medical education, assessment, and academic administration to provide tips to successfully incorporate behavioral assessments into instructional designs. These include tips for identifying the best assessment methods fit for purpose, guiding instructors in establishing boundaries of assessment, managing instructors, selecting raters, generating behavioral assessment guides, training raters, ensuring logistics support assessment strategies, and fostering capacity for iteration. These can be used by institutions to improve planning and implementation for longitudinal behavioral assessments.

Keywords

References

  1. J Allied Health. 2007 Fall;36(3):157-64 [PMID: 17941410]
  2. ANZ J Surg. 2009 Mar;79(3):154-60 [PMID: 19317781]
  3. Med Teach. 2017 Jun;39(6):603-608 [PMID: 28598736]
  4. Acad Med. 2023 Feb 1;98(2):162-170 [PMID: 35947473]
  5. J Eval Clin Pract. 2020 Aug;26(4):1087-1095 [PMID: 31820556]
  6. Med Educ Online. 2018 Dec;23(1):1457394 [PMID: 29608133]
  7. Med Educ. 2016 Jul;50(7):721-9 [PMID: 27295476]
  8. Med Teach. 2010;32(8):638-45 [PMID: 20662574]
  9. J Multidiscip Healthc. 2016 Feb 22;9:69-82 [PMID: 26955280]
  10. J Contin Educ Health Prof. 2012 Fall;32(4):279-86 [PMID: 23280532]
  11. Res Nurs Health. 2009 Aug;32(4):465-74 [PMID: 19434651]
  12. Med Teach. 2020 Jul;42(7):756-761 [PMID: 32450049]
  13. Cureus. 2020 Nov 6;12(11):e11363 [PMID: 33304696]
  14. Nurse Educ Today. 2020 May 07;91:104468 [PMID: 32454316]
  15. Early Child Res Q. 2010 Summer;25(3):284-298 [PMID: 22844183]
  16. Med Teach. 2010;32(12):e517-31 [PMID: 21090939]
  17. Acad Med. 2022 Mar 1;97(3S):S90-S97 [PMID: 34817404]
  18. J Grad Med Educ. 2021 Apr;13(2 Suppl):113-119 [PMID: 33936544]
  19. Simul Healthc. 2015 Aug;10(4):249-55 [PMID: 26098494]
  20. Ann Surg. 2009 Jun;249(6):1047-51 [PMID: 19474694]

Word Cloud

Created with Highcharts 10.0.0assessmenteducationbehavioralmedicalcompetency-basedassessmentsinstitutionstipsinstructionalinstructorsraterscontinuouslystrivealignstandardssetforthwithinincreasedneedproduceevidencelearnerachievementformobservablebehaviorsHowevercomplexityhealthcareclinicalenvironmentsmakechallenginggeneratevalidreliablearticleutilizeinterdisciplinaryknowledgeperspectivesexpertsacademicadministrationprovidesuccessfullyincorporatedesignsincludeidentifyingbestmethodsfitpurposeguidingestablishingboundariesmanagingselectinggeneratingguidestrainingensuringlogisticssupportstrategiesfosteringcapacityiterationcanusedimproveplanningimplementationlongitudinalIntegratingdesignobservationalratingsraterselectionundergraduate

Similar Articles

Cited By