A systematic review: the dimensions to evaluate health care performance and an implication during the pandemic.

Faten Amer, Sahar Hammoud, Haitham Khatatbeh, Szimonetta Lohner, Imre Boncz, Dóra Endrei
Author Information
  1. Faten Amer: Doctoral School of Health Sciences, Faculty of Health Sciences, University of Pécs, Pécs, Hungary. amer.faten@etk.pte.hu. ORCID
  2. Sahar Hammoud: Doctoral School of Health Sciences, Faculty of Health Sciences, University of Pécs, Pécs, Hungary.
  3. Haitham Khatatbeh: Doctoral School of Health Sciences, Faculty of Health Sciences, University of Pécs, Pécs, Hungary.
  4. Szimonetta Lohner: Clinical Center of the University of Pécs, Medical School, Cochrane Hungary, University of Pécs, Pécs, Hungary.
  5. Imre Boncz: Faculty of Health Sciences, Institute for Health Insurance, University of Pécs, Pécs, Hungary.
  6. Dóra Endrei: Faculty of Health Sciences, Institute for Health Insurance, University of Pécs, Pécs, Hungary.

Abstract

BACKGROUND: The balanced scorecard (BSC) has been implemented to evaluate the performance of health care organizations (HCOs). BSC proved to be effective in improving financial performance and patient satisfaction.
AIM: This systematic review aims to identify all the perspectives, dimensions, and KPIs that are vital and most frequently used by health care managers in BSC implementations.
METHODS: This systematic review adheres to PRISMA guidelines. The PubMed, Embase, Cochrane, and Google Scholar databases and Google search engine were inspected to find all implementations of BSC at HCO. The risk of bias was assessed using the nonrandomized intervention studies (ROBINS-I) tool to evaluate the quality of observational and quasi-experimental studies and the Cochrane (RoB 2) tool for randomized controlled trials (RCTs).
RESULTS: There were 33 eligible studies, of which we identified 36 BSC implementations. The categorization and regrouping of the 797 KPIs resulted in 45 subdimensions. The reassembly of these subdimensions resulted in 13 major dimensions: financial, efficiency and effectiveness, availability and quality of supplies and services, managerial tasks, health care workers' (HCWs) scientific development error-free and safety, time, HCW-centeredness, patient-centeredness, technology, and information systems, community care and reputation, HCO building, and communication. On the other hand, this review detected that BSC design modification to include external and managerial perspectives was necessary for many BSC implementations.
CONCLUSION: This review solves the KPI categorization dilemma. It also guides researchers and health care managers in choosing dimensions for future BSC implementations and performance evaluations in general. Consequently, dimension uniformity will improve the data sharing and comparability among studies. Additionally, despite the pandemic negatively influencing many dimensions, the researchers observed a lack of comprehensive HCO performance evaluations. In the same vein, although some resulting dimensions were assessed separately during the pandemic, other dimensions still lack investigation. Last, BSC dimensions may play an essential role in tackling the COVID-19 pandemic. However, further research is required to investigate the BSC implementation effect in mitigating the pandemic consequences on HCO.

Keywords

References

  1. Biology (Basel). 2020 Sep 05;9(9): [PMID: 32899457]
  2. Eval Health Prof. 2021 Sep;44(3):319-322 [PMID: 33902348]
  3. Int J Health Care Qual Assur Inc Leadersh Health Serv. 2004;17(6):323-33 [PMID: 15552387]
  4. PLoS One. 2020 Nov 6;15(11):e0242126 [PMID: 33156873]
  5. J Healthc Qual. 2006 Sep-Oct;28(5):28-32, 55 [PMID: 17518021]
  6. Bull World Health Organ. 2007 Feb;85(2):146-51 [PMID: 17308736]
  7. Int J Qual Health Care. 2009 Apr;21(2):119-29 [PMID: 19155288]
  8. BMC Health Serv Res. 2019 Feb 22;19(1):132 [PMID: 30795742]
  9. J Environ Public Health. 2021 Jan 30;2021:6614565 [PMID: 33564314]
  10. Transl Psychiatry. 2021 Feb 18;11(1):133 [PMID: 33602920]
  11. BMC Health Serv Res. 2015 Jul 31;15:299 [PMID: 26227814]
  12. Int J Health Care Qual Assur Inc Leadersh Health Serv. 2006;19(4-5):339-50 [PMID: 16961099]
  13. BMC Health Serv Res. 2022 Jan 13;22(1):65 [PMID: 35027048]
  14. Int J Inf Manage. 2021 Apr;57:102287 [PMID: 33318721]
  15. Int J Health Care Qual Assur. 2015;28(5):520-31 [PMID: 26020432]
  16. Appl Nurs Res. 2021 Jun;59:151416 [PMID: 33947510]
  17. BMC Public Health. 2021 Apr 28;21(1):811 [PMID: 33906619]
  18. PLoS Med. 2009 Jul 21;6(7):e1000100 [PMID: 19621070]
  19. BMC Health Serv Res. 2017 Aug 3;17(1):522 [PMID: 28774295]
  20. J Palliat Med. 2020 Mar;23(3):306-307 [PMID: 32105557]
  21. BMJ Open Qual. 2021 Jul;10(3): [PMID: 34244173]
  22. Waste Manag Res. 2021 Jun;39(1_suppl):45-55 [PMID: 33794685]
  23. Anesth Analg. 2002 Dec;95(6):1731-8, table of contents [PMID: 12456449]
  24. Harv Bus Rev. 2000 Nov-Dec;78(6):57-62, 64, 66-7 [PMID: 11184977]
  25. JCO Glob Oncol. 2020 Oct;6:1494-1509 [PMID: 33017179]
  26. J Int Med Res. 2018 May;46(5):1947-1962 [PMID: 29562812]
  27. Aust Health Rev. 2014 May;38(2):208-17 [PMID: 24589328]
  28. Int J Qual Health Care. 2010 Feb;22(1):44-69 [PMID: 19951964]
  29. Can J Infect Dis Med Microbiol. 2021 Feb 25;2021:6650920 [PMID: 33680220]
  30. Int J Health Plann Manage. 2018 Jan;33(1):6-30 [PMID: 28474468]
  31. BMJ Glob Health. 2020 Sep;5(9): [PMID: 32978213]
  32. Int J Health Plann Manage. 2013 Apr-Jun;28(2):181-201 [PMID: 23081849]
  33. Front Public Health. 2021 Jan 18;8:560606 [PMID: 33537272]
  34. BMC Med. 2020 Oct 16;18(1):329 [PMID: 33066777]
  35. Patient Prefer Adherence. 2021 Apr 07;15:677-690 [PMID: 33854302]
  36. PLoS One. 2021 Jan 7;16(1):e0245025 [PMID: 33411780]
  37. BMJ. 2020 Apr 2;369:m1378 [PMID: 32241815]
  38. Int J Qual Health Care. 2021 Mar 31;33(1): [PMID: 33734378]
  39. Int J Health Plann Manage. 2008 Apr-Jun;23(2):107-17 [PMID: 18435428]
  40. BMC Health Serv Res. 2014 Oct 01;14:448 [PMID: 25269656]
  41. Patient Educ Couns. 2008 Feb;70(2):234-41 [PMID: 18023129]
  42. BMC Med. 2020 Sep 3;18(1):270 [PMID: 32878619]
  43. Postgrad Med J. 2021 Jun;97(1148):406 [PMID: 32611775]
  44. J Educ Health Promot. 2013 Feb 28;2:7 [PMID: 24083257]
  45. Waste Manag Res. 2021 Jun;39(1_suppl):56-63 [PMID: 33843362]
  46. Healthc Q. 2020 Oct;23(3):24-28 [PMID: 33243362]
  47. Harv Bus Rev. 1992 Jan-Feb;70(1):71-9 [PMID: 10119714]
  48. Int J Equity Health. 2020 Sep 4;19(1):152 [PMID: 32887629]
  49. PLoS One. 2021 Feb 3;16(2):e0245772 [PMID: 33534813]
  50. Healthc Q. 2005;8(4):58-65 [PMID: 16323516]
  51. PLoS One. 2021 Mar 16;16(3):e0248714 [PMID: 33724999]
  52. Invest Educ Enferm. 2020 Oct;38(3): [PMID: 33306899]
  53. Cost Eff Resour Alloc. 2011 May 17;9(1):7 [PMID: 21586111]
  54. Glob Health Action. 2020 Dec 31;13(1):1763078 [PMID: 32508273]
  55. BMC Health Serv Res. 2014 Nov 21;14:579 [PMID: 25413154]
  56. Res Synth Methods. 2021 Jan;12(1):55-61 [PMID: 32336025]
  57. BMJ. 2016 Oct 12;355:i4919 [PMID: 27733354]
  58. Disaster Med Public Health Prep. 2021 Apr;15(2):e15-e22 [PMID: 32576332]
  59. PLoS Med. 2011 Jul;8(7):e1001066 [PMID: 21814499]
  60. Int J Qual Health Care. 2006 Sep;18 Suppl 1:5-13 [PMID: 16954510]
  61. J Community Hosp Intern Med Perspect. 2021 Mar 23;11(2):180-183 [PMID: 33889316]
  62. J Environ Health Sci Eng. 2021 Mar 18;19(1):831-836 [PMID: 33758671]
  63. J Healthc Qual. 2007 Sep-Oct;29(5):21-34 [PMID: 17892079]
  64. PLoS One. 2021 Apr 16;16(4):e0250294 [PMID: 33861808]
  65. Health Care Manage Rev. 2006 Oct-Dec;31(4):280-8 [PMID: 17077702]
  66. J Health Care Finance. 2003 Summer;29(4):1-16 [PMID: 12908650]
  67. Int J Health Plann Manage. 2013 Apr-Jun;28(2):202-15 [PMID: 22887590]
  68. Healthc Manage Forum. 1995 Winter;8(4):7-21 [PMID: 10156487]
  69. PLoS One. 2014 Apr 21;9(4):e93977 [PMID: 24751780]
  70. J Adv Nurs. 2005 Dec;52(5):546-53 [PMID: 16268861]
  71. J Public Health Res. 2021 Mar 02;10(1):1956 [PMID: 33708749]
  72. J Healthc Qual. 2003 May-Jun;25(3):33-9 [PMID: 12774646]
  73. J Bus Res. 2021 Jan;122:597-607 [PMID: 33518844]
  74. Int J Environ Res Public Health. 2020 Sep 25;17(19): [PMID: 32993013]
  75. Healthcare (Basel). 2020 Dec 25;9(1): [PMID: 33375693]
  76. BMC Health Serv Res. 2018 Dec 12;18(1):963 [PMID: 30541537]
  77. PLoS One. 2021 Jun 1;16(6):e0252441 [PMID: 34061888]
  78. J Healthc Manag. 2002 Jan-Feb;47(1):41-57 [PMID: 11836965]
  79. Sci Total Environ. 2021 Jul 15;778:146220 [PMID: 33711590]
  80. J Health Care Finance. 2001 Spring;27(3):1-20 [PMID: 14680029]
  81. Health Expect. 2021 Jun;24(3):967-977 [PMID: 33761175]
  82. JAMA. 2020 Jun 2;323(21):2127-2128 [PMID: 32364565]
  83. J Chin Med Assoc. 2012 Oct;75(10):530-5 [PMID: 23089406]
  84. BMC Health Serv Res. 2021 Jan 22;21(1):82 [PMID: 33482807]
  85. Nurs Econ. 2009 Nov-Dec;27(6):401-7 [PMID: 20050491]
  86. Adv Exp Med Biol. 2020;1194:1-22 [PMID: 32468519]
  87. Front Psychol. 2021 Mar 10;12:623873 [PMID: 33776846]
  88. BMC Public Health. 2020 Aug 1;20(1):1193 [PMID: 32738884]
  89. J Hosp Med. 2020 Jun;15(6):363-366 [PMID: 32490798]
  90. BMJ. 2020 Sep 11;370:m3557 [PMID: 32917660]
  91. Confl Health. 2014 Nov 25;8:24 [PMID: 25926867]
  92. Am J Trop Med Hyg. 2016 May 4;94(5):1157-69 [PMID: 26928842]
  93. PLoS One. 2021 Mar 9;16(3):e0248282 [PMID: 33690699]
  94. JAMA. 2020 Jul 28;324(4):333-334 [PMID: 32584373]
  95. J Clin Epidemiol. 2020 Mar;119:57-64 [PMID: 31734347]
  96. BMC Health Serv Res. 2020 Nov 12;20(1):1038 [PMID: 33183304]
  97. JAMA Intern Med. 2020 Oct 1;180(10):1328-1333 [PMID: 32744612]
  98. Int J Qual Health Care. 2005 Dec;17(6):487-96 [PMID: 16155049]
  99. BMJ Open. 2021 Mar 16;11(3):e045343 [PMID: 33727273]
  100. Ann Med Surg (Lond). 2020 Oct;58:14-19 [PMID: 32864124]
  101. Health Policy Plan. 2015 Mar;30(2):234-41 [PMID: 24561877]
  102. Inform Med Unlocked. 2020;21:100475 [PMID: 33204821]
  103. JMIR Form Res. 2020 Sep 18;4(9):e20606 [PMID: 32640419]

MeSH Term

COVID-19
Health Facilities
Health Personnel
Humans
Pandemics
Patient Satisfaction

Word Cloud

Created with Highcharts 10.0.0BSCdimensionscareperformancehealthimplementationspandemicreviewHCOstudiesevaluatesystematicscorecardfinancialperspectivesKPIsmanagersCochraneGoogleassessedtoolqualitycategorizationresultedsubdimensionsmanagerialmanyresearchersevaluationslackCOVID-19BACKGROUND:balancedimplementedorganizationsHCOsprovedeffectiveimprovingpatientsatisfactionAIM:aimsidentifyvitalfrequentlyusedMETHODS:adheresPRISMAguidelinesPubMedEmbaseScholardatabasessearchengineinspectedfindriskbiasusingnonrandomizedinterventionROBINS-Iobservationalquasi-experimentalRoB2randomizedcontrolledtrialsRCTsRESULTS:33eligibleidentified36regrouping79745reassembly13majordimensions:efficiencyeffectivenessavailabilitysuppliesservicestasksworkers'HCWsscientificdevelopmenterror-freesafetytimeHCW-centerednesspatient-centerednesstechnologyinformationsystemscommunityreputationbuildingcommunicationhanddetecteddesignmodificationincludeexternalnecessaryCONCLUSION:solvesKPIdilemmaalsoguideschoosingfuturegeneralConsequentlydimensionuniformitywillimprovedatasharingcomparabilityamongAdditionallydespitenegativelyinfluencingobservedcomprehensiveveinalthoughresultingseparatelystillinvestigationLastmayplayessentialroletacklingHoweverresearchrequiredinvestigateimplementationeffectmitigatingconsequencesreview:implicationAssessmentBalancedEvaluationHealthHospitalIndicatorsPerformance

Similar Articles

Cited By