Assessing clinical communication skills in physicians: are the skills context specific or generalizable.

Lubna A Baig, Claudio Violato, Rodney A Crutcher
Author Information
  1. Lubna A Baig: Alberta International Medical Graduate Program, and Community Health Sciences, University of Calgary, Calgary, Canada. lbaig@ucalgary.ca

Abstract

BACKGROUND: Communication skills are essential for physicians to practice Medicine. Evidence for the validity and domain specificity of communication skills in physicians is equivocal and requires further research. This research was conducted to adduce evidence for content and context specificity of communication skills and to assess the usefulness of a generic instrument for assessing communication skills in International Medical Graduates (IMGs).
METHODS: A psychometric design was used for identifying the reliability and validity of the communication skills instruments used for high-stakes exams for IMG's. Data were collected from 39 IMGs (19 men--48.7%; 20 women--51.3%; Mean age = 41 years) assessed at 14 station OSCE and subsequently in supervised clinical practice with several instruments (patient surveys; ITERs; Mini-CEX).
RESULTS: All the instruments had adequate reliability (Cronbach's alpha: .54 - .96). There were significant correlations (r range: 0.37 - 0.70, p < .05) of communication skills assessed by examiner with standardized patients, and of mini-CEX with patient surveys, and ITERs. The intra-item reliability across all cases for the 13 items was low (Cronbach's alpha: .20 - .56). The correlations of communication skills within method (e.g., OSCE or clinical practice) were significant but were non-significant between methods (e.g., OSCE and clinical practice).
CONCLUSION: The results provide evidence of context specificity of communication skills, as well as convergent and criterion-related validity of communication skills. Both in OSCEs and clinical practice, communication checklists need to be case specific, designed for content validity.

References

  1. Acad Med. 2002 Jan;77(1):82-6 [PMID: 11788330]
  2. Acad Med. 2003 Aug;78(8):826-30 [PMID: 12915378]
  3. CMAJ. 1999 Jul 13;161(1):52-7 [PMID: 10420867]
  4. Med Educ. 2002 Sep;36(9):842-52 [PMID: 12354247]
  5. J Clin Oncol. 2001 Sep 15;19(18 Suppl):61S-63S [PMID: 11560975]
  6. Acad Med. 1999 Mar;74(3):271-4 [PMID: 10099650]
  7. Acad Med. 1999 Oct;74(10 Suppl):S135-7 [PMID: 10536618]
  8. Acad Med. 2000 Oct;75(10 Suppl):S93-5 [PMID: 11031186]
  9. Med Educ. 1996 Jan;30(1):38-43 [PMID: 8736187]
  10. Adv Health Sci Educ Theory Pract. 2004;9(1):47-60 [PMID: 14739761]
  11. Adv Health Sci Educ Theory Pract. 2004;9(3):179-87 [PMID: 15316269]
  12. Adv Health Sci Educ Theory Pract. 2002;7(2):85-97 [PMID: 12075142]
  13. Mt Sinai J Med. 2002 Nov;69(6):378-84 [PMID: 12429956]
  14. Acad Med. 2000 Dec;75(12):1206-11 [PMID: 11112723]

MeSH Term

Adult
Communication
Female
Health Care Surveys
Humans
Male
Middle Aged
Physician-Patient Relations
Physicians
Professional Competence
Psychometrics

Word Cloud

Created with Highcharts 10.0.0skillscommunicationpracticeclinicalvalidityspecificitycontextreliabilityinstrumentsOSCE-physiciansresearchevidencecontentIMGsused20assessedpatientsurveysITERsCronbach'salpha:significantcorrelations0egspecificBACKGROUND:CommunicationessentialMedicineEvidencedomainequivocalrequiresconductedadduceassessusefulnessgenericinstrumentassessingInternationalMedicalGraduatesMETHODS:psychometricdesignidentifyinghigh-stakesexamsIMG'sDatacollected3919men--487%women--513%Meanage=41years14stationsubsequentlysupervisedseveralMini-CEXRESULTS:adequate5496rrange:3770p<05examinerstandardizedpatientsmini-CEXintra-itemacrosscases13itemslow56withinmethodnon-significantmethodsCONCLUSION:resultsprovidewellconvergentcriterion-relatedOSCEschecklistsneedcasedesignedAssessingphysicians:generalizable

Similar Articles

Cited By