The Context of "Confidence": Analyzing the Term Confidence in Resident Evaluations.

Janae K Heath, Meagan E Alvarado, Caitlin B Clancy, Todd D Barton, Jennifer R Kogan, C Jessica Dine
Author Information
  1. Janae K Heath: Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA. janae.heath@pennmedicine.upenn.edu. ORCID
  2. Meagan E Alvarado: Yale School of Medicine, New Haven, CT, USA.
  3. Caitlin B Clancy: Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA.
  4. Todd D Barton: Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA.
  5. Jennifer R Kogan: Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA.
  6. C Jessica Dine: Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA.

Abstract

BACKGROUND: Despite similar performance metrics, women medical trainees routinely self-assess their own skills lower than men. The phenomenon of a "confidence gap" between genders, where women report lower self-confidence independent of actual ability or competency, may have an important interaction with gender differences in assessment. Identifying whether there are gender-based differences in how confidence is mentioned in written evaluations is a necessary step to understand the interaction between evaluation and the gender-based confidence gap.
OBJECTIVE: To analyze faculty evaluations of internal medicine (IM) residents for gender-based patterns in the use of iterations of "confidence."
DESIGN: We performed a retrospective cohort study of all inpatient faculty evaluations of University of Pennsylvania IM residents from 2018 to 2021. We performed n-gram text-mining to identify evaluations containing the terms "confident," "confidence," or "confidently." We performed univariable and multivariable logistic regression to determine the association between resident gender and references to confidence (including comments reflecting too little confidence), adjusting for faculty gender, post-graduate year (PGY), numeric rating, and service.
SUBJECTS: University of Pennsylvania IM residents from 2018 to 2021.
KEY RESULTS: There were 5416 evaluations of IM residents (165 women [51%], 156 men [49%]) submitted by 356 faculty members (149 women [51%]), of which 7.1 % (n=356) contained references to confidence. There was a significant positive association between the mention of confidence and women resident gender (OR 1.54, CI 1.23-1.92; p<0.001), which persisted after adjustment for faculty gender, numeric rating, and PGY level. Eighty evaluations of the cohort explicitly mentioned the resident having "too little confidence," which was also associated with women resident gender (OR 1.66, CI 1.05-2.62; p=0.031).
CONCLUSION: Narrative evaluations of women residents were more likely to contain references to confidence, after adjustment for numerical score, PGY level, and faculty gender, which may perpetuate the gender-based confidence gap, introduce bias, and ultimately impact professional identity development.

Keywords

References

  1. Diabetes Care. 2005 Jul;28(7):1594-8 [PMID: 15983306]
  2. J Gen Intern Med. 1998 Oct;13(10):670-4 [PMID: 9798813]
  3. JAMA. 1998 Sep 2;280(9):767-71 [PMID: 9729986]
  4. Acad Med. 2022 Mar 1;97(3):406-413 [PMID: 34709203]
  5. JAMA Intern Med. 2017 Feb 1;177(2):206-213 [PMID: 27992617]
  6. Br J Educ Psychol. 2010 Dec;80(Pt 4):689-709 [PMID: 20307375]
  7. BMJ. 2019 Dec 16;367:l6573 [PMID: 31843745]
  8. Acad Med. 2009 Mar;84(3):381-4 [PMID: 19240452]
  9. Am J Surg. 2014 May;207(5):797-805 [PMID: 24530093]
  10. CMAJ. 2013 May 14;185(8):649-53 [PMID: 23569163]
  11. J Grad Med Educ. 2017 Oct;9(5):577-585 [PMID: 29075375]
  12. JAMA Netw Open. 2020 Jul 1;3(7):e2010888 [PMID: 32672831]
  13. Biom J. 2018 May;60(3):431-449 [PMID: 29292533]
  14. Obstet Gynecol Int. 2017;2017:1945801 [PMID: 28203253]
  15. Am J Surg. 2019 Feb;217(2):301-305 [PMID: 30580935]
  16. JAMA Netw Open. 2019 May 3;2(5):e193520 [PMID: 31074813]
  17. J Grad Med Educ. 2020 Dec;12(6):710-716 [PMID: 33391595]
  18. J Grad Med Educ. 2019 Feb;11(1):44-52 [PMID: 30805097]
  19. J Womens Health (Larchmt). 2003 Jan-Feb;12(1):73-80 [PMID: 12639371]
  20. N Engl J Med. 1993 Aug 12;329(7):478-82 [PMID: 8332153]
  21. Proc Natl Acad Sci U S A. 2020 Dec 1;117(48):30303-30308 [PMID: 33199594]
  22. J Surg Educ. 2017 Nov - Dec;74(6):e111-e118 [PMID: 28669788]
  23. Acad Med. 2013 Jan;88(1):44-8 [PMID: 23165273]
  24. J Pers Soc Psychol. 1990 Sep;59(3):538-49 [PMID: 2231284]
  25. Eur J Heart Fail. 2009 Mar;11(3):299-303 [PMID: 19158153]
  26. Women Health. 1997;26(1):29-39 [PMID: 9311098]
  27. Front Psychol. 2020 Oct 07;11:552355 [PMID: 33162905]
  28. J Womens Health (Larchmt). 2020 Jun;29(6):837-846 [PMID: 32466701]
  29. J Intern Med. 2008 Oct;264(4):340-50 [PMID: 18397244]
  30. J Gen Intern Med. 2019 May;34(5):712-719 [PMID: 30993611]
  31. J Anat. 2014 Mar;224(3):279-85 [PMID: 23781887]

MeSH Term

Clinical Competence
Cohort Studies
Faculty, Medical
Female
Humans
Internship and Residency
Male
Mental Processes
Retrospective Studies

Word Cloud

Created with Highcharts 10.0.0confidencegenderwomenevaluationsfacultyresidents1gender-basedIM"resident"confidencegapperformedreferencesPGYlowermenmayinteractiondifferencesassessmentmentionedevaluationcohortUniversityPennsylvania20182021associationlittlenumericrating[51%]ORCIadjustmentlevelbiasBACKGROUND:Despitesimilarperformancemetricsmedicaltraineesroutinelyself-assessskillsphenomenongap"gendersreportself-confidenceindependentactualabilitycompetencyimportantIdentifyingwhetherwrittennecessarystepunderstandOBJECTIVE:analyzeinternalmedicinepatternsuseiterations"DESIGN:retrospectivestudyinpatientn-gramtext-miningidentifycontainingterms"confident"confidentlyunivariablemultivariablelogisticregressiondetermineincludingcommentsreflectingadjustingpost-graduateyearserviceSUBJECTS:KEYRESULTS:5416165156[49%]submitted356members1497%n=356containedsignificantpositivemention5423-192p<0001persistedEightyexplicitly"tooalsoassociated6605-262p=0031CONCLUSION:NarrativelikelycontainnumericalscoreperpetuateintroduceultimatelyimpactprofessionalidentitydevelopmentContext"Confidence":AnalyzingTermConfidenceResidentEvaluationsnarrative

Similar Articles

Cited By