Entrustment versus performance scale in high-stakes OSCEs: Rater insights and psychometric properties.

Severin Pinilla, Seraina Lerch, Raphaela Lüdi, Florian Neubauer, Sabine Feller, Daniel Stricker, Christoph Berendonk, Sören Huwendiek
Author Information
  1. Severin Pinilla: University Hospital of Old Age Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland. ORCID
  2. Seraina Lerch: University Hospital of Old Age Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland. ORCID
  3. Raphaela Lüdi: Department for Assessment and Evaluation, Institute for Medical Education, University of Bern, Bern, Switzerland.
  4. Florian Neubauer: Department for Assessment and Evaluation, Institute for Medical Education, University of Bern, Bern, Switzerland. ORCID
  5. Sabine Feller: Department for Assessment and Evaluation, Institute for Medical Education, University of Bern, Bern, Switzerland.
  6. Daniel Stricker: Department for Assessment and Evaluation, Institute for Medical Education, University of Bern, Bern, Switzerland.
  7. Christoph Berendonk: Department for Assessment and Evaluation, Institute for Medical Education, University of Bern, Bern, Switzerland. ORCID
  8. Sören Huwendiek: Department for Assessment and Evaluation, Institute for Medical Education, University of Bern, Bern, Switzerland. ORCID

Abstract

BACKGROUND: Although entrustment scales are increasingly applied in workplace-based assessments, their role in OSCEs remains unclear. We investigated raters' perceptions using an entrustment scale and psychometric analyses.
METHOD: A mixed-methods design was used. OSCE raters' ( = 162) perceptions were explored questionnaire and four focus groups ( = 14). Psychometric OSCE properties were analyzed statistically.
RESULTS: Raters ( = 53, response rate = 41%) considered the entrustment scale comprehensible (89%) and applicable (60%). A total of 43% preferred the entrustment scale, 21% preferred the global performance scale, and 36% were undecided. Raters' written comments indicated that while they appreciated the authenticity of entrustment levels, they considered them subjective. The focus groups highlighted three main themes: (1) recollections of the clinical workplace as a cognitive reference triggered by entrustment scales; (2) factors influencing entrustment decisions; and (3) cognitive load is reduced at the perceived cost of objectivity. Psychometric analyses ( = 480 students) revealed improvements in some OSCE metrics when entrustment and global performance scales were combined.
CONCLUSION: Entrustment scales are beneficial for high-stakes OSCEs and have greater clinical relevance from the raters' perspective. Our findings support the use of entrustment and global performance scales in combination.

Keywords

MeSH Term

Humans
Psychometrics
Clinical Competence
Educational Measurement
Students, Medical

Word Cloud

Similar Articles

Cited By