Identification, Characterization, and Ranking of Candidate Metrics for Selection to Anesthesiology Residency: An Iterative Survey of Program Directors.

Michael P Hofkamp, Daniel Saddawi-Konefka, Emily G Teeter, Fasa George Guldan, Clinton Kakazu, Brittany Maggard, Ned Nasr, Michelle Parra, Arvind Rajagopal, Kelly Ural, Courtney Shaver, Jed Wolpaw
Author Information
  1. Michael P Hofkamp: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  2. Daniel Saddawi-Konefka: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  3. Emily G Teeter: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  4. Fasa George Guldan: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  5. Clinton Kakazu: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  6. Brittany Maggard: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  7. Ned Nasr: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  8. Michelle Parra: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  9. Arvind Rajagopal: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  10. Kelly Ural: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  11. Courtney Shaver: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.
  12. Jed Wolpaw: is Director of Undergraduate Medical Education in the Department of Anesthesiology, Baylor Scott & White Medical Center-Temple, Temple, TX. is a Core Residency Program Director in the Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA. is a Core Residency Associate Program Director in the Department of Anesthesiology, University of North Carolina, Chapel Hill, NC. is a Core Residency Program Director in the Department of Anesthesia and Perioperative Medicine, Medical University of South Carolina, Charleston, SC. is a Core Residency Program Director in the Department of Anesthesiology, Harbor-UCLA Medical Center, Torrance, CA. is a Core Residency Program Director in the Department of Anesthesiology and Perioperative Medicine, University of Louisville School of Medicine, Louisville, KY. is a Core Residency Program Director in the Department of Anesthesiology, Advocate Illinois Masonic Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesia, University of Iowa Carver College of Medicine, Iowa City, IA. is a Core Residency Program Director in the Department of Anesthesiology, Rush University Medical Center, Chicago, IL. is a Core Residency Program Director in the Department of Anesthesiology, Ochsner Medical Center, New Orleans, LA. is a Biostatistician in the Biostatistics Core, Baylor Scott & White Research Institute, Temple, TX. is a Core Residency Program Director in the Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD.

Abstract

Background: The primary aim of this study was to identify and stratify candidate metrics used by anesthesiology residency program directors (PDs) to develop their residency rank lists through the National Resident Matching Program.
Methods: Sixteen PDs comprised the participants, selected for diversity in geography and program size. We used a 3-round iterative survey to identify and stratify candidate metrics. In the first round, participants listed metrics they planned to use to evaluate candidates. In the second round, metrics from the first round were ranked by importance, and criteria were solicited to define an exceptional, strong, average, marginal, and uncompetitive candidate for each metric. In the third round, aggregated results were presented and participants refined their rankings.
Results: Of the 16 PDs selected, 15 participated in the first and second survey rounds, and 10 in the third. Eighteen candidate metrics were indicated by 8 or more PDs for residency selection. All 10 PDs from the final round identified passing Step 1 of the United States Medical Licensing Exam (USMLE) and the absence of "red flags" like a failed rotation as key selection metrics, both averaging an importance score of 4.9 out of 5. Other metrics identified by all PDs included clerkship evaluation comments, USMLE Step 2 scores, class rank, letters of recommendation, personal statement, and program and geographical signals.
Conclusions: The study reveals key metrics anesthesiology residency PDs use for candidate ranking, which may offer candidates insights into their competitiveness for anesthesiology residency.

Keywords

References

  1. Am J Obstet Gynecol. 2021 Nov;225(5):554.e1-554.e11 [PMID: 34506753]
  2. J Educ Perioper Med. 2020 Jul 01;22(3):E646 [PMID: 33225016]
  3. Clin Orthop Relat Res. 2023 Feb 1;481(2):387-396 [PMID: 36083836]
  4. J Vasc Surg. 2021 Aug;74(2S):29S-32S [PMID: 34303456]
  5. JAMA Netw Open. 2022 Sep 1;5(9):e2229062 [PMID: 36069984]
  6. Med Educ Online. 2021 Dec;26(1):1924599 [PMID: 33960915]
  7. J Educ Perioper Med. 2023 Apr 1;25(2):E702 [PMID: 37377506]
  8. J Biomed Inform. 2019 Jul;95:103208 [PMID: 31078660]
  9. J Surg Res. 2019 Mar;235:447-452 [PMID: 30691828]
  10. West J Emerg Med. 2022 May 10;23(3):345-352 [PMID: 35679505]
  11. JMIR Med Educ. 2023 Jan 6;9:e37069 [PMID: 36607718]
  12. J Grad Med Educ. 2013 Jun;5(2):276-83 [PMID: 24404273]
  13. Med Educ Online. 2017;22(1):1358579 [PMID: 28762297]
  14. JAMA Netw Open. 2022 Nov 1;5(11):e2240817 [PMID: 36367730]
  15. Dermatol Online J. 2020 Oct 15;26(10): [PMID: 33147664]
  16. J Neurosurg. 2023 Apr 21;139(5):1456-1462 [PMID: 37086164]
  17. Cureus. 2022 Jun 15;14(6):e25962 [PMID: 35855255]
  18. Cureus. 2020 Nov 18;12(11):e11550 [PMID: 33365219]

Word Cloud

Created with Highcharts 10.0.0metricsPDsresidencycandidateroundanesthesiologyprogramparticipantsfirstselectionstudyidentifystratifyusedrankProgramselectedsurveyusecandidatessecondimportancethird10identifiedStepUSMLEkeyBackground:primaryaimdirectorsdeveloplistsNationalResidentMatchingMethods:Sixteencompriseddiversitygeographysize3-rounditerativelistedplannedevaluaterankedcriteriasoliciteddefineexceptionalstrongaveragemarginaluncompetitivemetricaggregatedresultspresentedrefinedrankingsResults:1615participatedroundsEighteenindicated8finalpassing1UnitedStatesMedicalLicensingExamabsence"redflags"likefailedrotationaveragingscore495includedclerkshipevaluationcomments2scoresclasslettersrecommendationpersonalstatementgeographicalsignalsConclusions:revealsrankingmayofferinsightscompetitivenessIdentificationCharacterizationRankingCandidateMetricsSelectionAnesthesiologyResidency:IterativeSurveyDirectorsUndergraduatemedicaleducation

Similar Articles

Cited By