OpenLB
Open Library of Bioscience
Advanced Search
BMJ open
11 06, 2020;10 (11): e038898.

Added value of assessing medical students' reflective writings in communication skills training: a longitudinal study in four academic centres.

Camila Ament Giuliani Franco, Renato Soleiman Franco, Dario Cecilio-Fernandes, Milton Severo, Maria Amélia Ferreira, Marco Antonio de Carvalho-Filho
Author Information
  1. Camila Ament Giuliani Franco: Medicine School, Pontifical Catholic University of Parana, Curitiba, Brazil.
  2. Renato Soleiman Franco: Medicine School and Post-Graduate Program in Bioethics, Pontifical Catholic University of Paraná, Curitiba, Brazil.
  3. Dario Cecilio-Fernandes: Department of Medical Psychology and Psychiatry, School of Medical Sciences, University of Campinas, Campinas, Brazil. ORCID
  4. Milton Severo: Department of Clinical Epidemiology, Predictive Medicine and Public Health and Public Health and Forensic Sciences, and Medical Education Department, University of Porto Medical School, Porto, Portugal.
  5. Maria Amélia Ferreira: Public Health and Forensic Sciences, and Medical Education Department, University of Porto Faculty of Medicine, Porto, Portugal.
  6. Marco Antonio de Carvalho-Filho: Internal Medicine, University of Minho School of Medicine, Braga, Portugal m.a.de.carvalho.filho@umcg.nl. ORCID
PMID: 33158823 DOI: 10.1136/bmjopen-2020-038898

Abstract

OBJECTIVES: This study describes the development and implementation of a model to assess students' communication skills highlighting the use of reflective writing. We aimed to evaluate the usefulness of the students' reflections in the assessment of communication skills.
DESIGN: Third-year and fourth-year medical students enrolled in an elective course on clinical communication skills development were assessed using different assessment methods.
SETTING AND PARTICIPANTS: The communication skills course was offered at four universities (three in Brazil and one in Portugal) and included 69 students.
OUTCOME MEASURES: The students were assessed by a Multiple-Choice Questionnaire (MCQ), an objective structured clinical examination (OSCE) and reflective writing narratives. The Cronbach's alpha, dimensionality and the person's correlation were applied to evaluate the reliability of the assessment methods and their correlations. Reflective witting was assessed by applying the Reflection Evaluation for Enhanced Competencies Tool Rubric (Reflect Score (RS)) to measure reflections' depth, and the Thematic Score (TS) to map and grade reflections' themes.
RESULTS: The Cronbach alpha for the MCQ, OSCE global score, TS and RS were, respectively, 0.697, 0.633, 0.784 and 0.850. The interobserver correlation for the TS and RS were, respectively, 0.907 and 0.816. The assessment of reflection using the TS was significantly correlated with the MCQ (r=0.412; p=0.019), OSCE (0.439; p=0.012) and RS (0.410; p=0.020). The RS did not correlate with the MCQ and OSCE.
CONCLUSIONS: Assessing reflection through mapping the themes and analysing the depth of reflective writing expands the assessment of communication skills. While the assessment of reflective themes is related to the cognitive and behavioural domains of learning, the reflective depth seems to be a specific competence, not correlated with other assessment methods-possibly a metacognitive domain.

Keywords

medical education & training medical ethics primary care

References

  1. Med Educ. 2014 Dec;48(12):1176-89 [PMID: 25413911]
  2. Perm J. 2017;21:17-013 [PMID: 29035184]
  3. J Pak Med Assoc. 2017 May;67(5):745-751 [PMID: 28507364]
  4. Acad Med. 2012 Jan;87(1):41-50 [PMID: 22104060]
  5. Med Teach. 2014 Jul;36(7):602-7 [PMID: 24787531]
  6. Med Teach. 2013 Nov;35(11):e1561-72 [PMID: 24004029]
  7. Adv Health Sci Educ Theory Pract. 2009 Oct;14(4):595-621 [PMID: 18034364]
  8. Acad Med. 2016 Feb;91(2):180-5 [PMID: 26332429]
  9. Patient Educ Couns. 2009 Mar;74(3):302-8 [PMID: 19135823]
  10. BMC Med Educ. 2014 Jan 13;14:10 [PMID: 24417939]
  11. Acad Med. 1990 Sep;65(9 Suppl):S63-7 [PMID: 2400509]
  12. Acad Med. 2012 May;87(5):603-9 [PMID: 22450174]
  13. Am J Pharm Educ. 2017 Feb 25;81(1):8 [PMID: 28289298]
  14. Med Educ. 2016 Dec;50(12):1253-1257 [PMID: 27873421]
  15. Patient Educ Couns. 2021 Jan;104(1):92-98 [PMID: 32624329]
  16. Acta Med Port. 2016 Dec 30;29(12):809-818 [PMID: 28425884]
  17. Fam Med. 2016 Nov;48(10):775-783 [PMID: 27875600]
  18. Arch Dis Child. 2014 Mar;99(3):279-83 [PMID: 23975720]
  19. Patient Educ Couns. 2020 Oct;103(10):2166-2172 [PMID: 32684444]
  20. Med Educ. 2004 Dec;38(12):1302-8 [PMID: 15566542]
  21. J Gen Intern Med. 2014 Jun;29(6):844-9 [PMID: 24481686]
  22. Med Teach. 2008;30(9-10):877-9 [PMID: 18825565]
  23. Med Educ. 2012 May;46(5):464-72 [PMID: 22515754]
  24. Med Educ. 2016 Jul;50(7):704-6 [PMID: 27295472]
  25. Ambul Pediatr. 2007 Jul-Aug;7(4):285-91 [PMID: 17660099]
  26. Acad Med. 2016 May;91(5):730-42 [PMID: 26796091]
  27. Acad Med. 2001 Apr;76(4):390-3 [PMID: 11299158]
  28. Ann Med Surg (Lond). 2018 Oct 09;36:29-40 [PMID: 30370054]
  29. J Fam Pract. 2000 Sep;49(9):796-804 [PMID: 11032203]
  30. Patient Educ Couns. 2018 Sep;101(9):1645-1653 [PMID: 29691110]
  31. Patient Educ Couns. 2016 Apr;99(4):600-609 [PMID: 26680755]
  32. Med Educ. 2018 May;52(5):497-512 [PMID: 29672937]
  33. J Med Humanit. 2006 Winter;27(4):231-44 [PMID: 17001529]
  34. Perspect Med Educ. 2016 Oct;5(5):285-91 [PMID: 27638391]
  35. Acad Med. 2003 Jul;78(7):742-7 [PMID: 12857697]
  36. Teach Learn Med. 2015;27(4):410-6 [PMID: 26507999]
  37. Fam Med. 2013 Jan;45(1):7-12 [PMID: 23334961]
  38. Acad Med. 2020 Jun;95(6):958-967 [PMID: 31688036]
  39. Med Educ. 2007 Feb;41(2):160-7 [PMID: 17269949]
  40. Patient Educ Couns. 2015 Oct;98(10):1287-91 [PMID: 26298220]
  41. Med Educ. 2015 May;49(5):461-75 [PMID: 25924122]
  42. J Educ Eval Health Prof. 2014 Aug 16;11:20 [PMID: 25112448]
  43. Perspect Med Educ. 2015 Dec;4(6):326-328 [PMID: 26553243]
  44. Med Teach. 2019 Jan;41(1):3-16 [PMID: 30634872]
  45. Med Educ. 2015 Sep;49(9):901-8 [PMID: 26296406]
  46. Med Educ. 1996 Mar;30(2):83-9 [PMID: 8736242]
  47. Physiother Theory Pract. 2014 Nov;30(8):572-80 [PMID: 24959969]
  48. Int J Med Educ. 2014 Dec 06;5:212-8 [PMID: 25480988]
  49. Med Educ. 1994 Jan;28(1):79-82 [PMID: 8208173]
  50. Med Teach. 2009 Aug;31(8):685-95 [PMID: 19811204]
  51. Med Teach. 2013 Jun;35(6):e1197-210 [PMID: 23676179]
  52. Acad Med. 2017 Apr;92(4):501-505 [PMID: 28351063]

MeSH Term

Brazil
Clinical Competence
Communication
Educational Measurement
Humans
Longitudinal Studies
Portugal
Reproducibility of Results
Students, Medical
Writing
Journal Article Research Support, Non-U.S. Gov't
Article has an altmetric score of 2

Word Cloud

Created with Highcharts 10.0.00assessmentcommunicationskillsreflectiveRSmedicalMCQOSCETSstudents'writingstudentsassesseddepththemesp=0studydevelopmentevaluatecourseclinicalusingmethodsfouralphacorrelationScorereflections'respectivelyreflectioncorrelatedOBJECTIVES:describesimplementationmodelassesshighlightinguseaimedusefulnessreflectionsDESIGN:Third-yearfourth-yearenrolledelectivedifferentSETTINGANDPARTICIPANTS:offereduniversitiesthreeBrazilonePortugalincluded69OUTCOMEMEASURES:Multiple-ChoiceQuestionnaireobjectivestructuredexaminationnarrativesCronbach'sdimensionalityperson'sappliedreliabilitycorrelationsReflectivewittingapplyingReflectionEvaluationEnhancedCompetenciesToolRubricReflectmeasureThematicmapgradeRESULTS:Cronbachglobalscore697633784850interobserver907816significantlyr=0412019439012410020correlateCONCLUSIONS:Assessingmappinganalysingexpandsrelatedcognitivebehaviouraldomainslearningseemsspecificcompetencemethods-possiblymetacognitivedomainAddedvalueassessingwritingstraining:longitudinalacademiccentreseducation&trainingethicsprimarycare

Similar Articles

Cited By (4)