Indicators and Measurement Tools for Health Systems Integration: A Knowledge Synthesis.

Esther Suter, Nelly D Oelke, Maria Alice Dias da Silva Lima, Michelle Stiphout, Robert Janke, Regina Rigatto Witt, Cheryl Van Vliet-Brown, Kaela Schill, Mahnoush Rostami, Shelanne Hepp, Arden Birney, Fatima Al-Roubaiai, Giselda Quintana Marques
Author Information
  1. Esther Suter: Faculty of Social Work, University of Calgary, CA.
  2. Nelly D Oelke: School of Nursing, University of British Columbia, Okanagan (UBCO), CA.
  3. Maria Alice Dias da Silva Lima: School of Nursing, Universidade Federal do Rio Grande do Sul (UFRGS), BR.
  4. Michelle Stiphout: Workforce Research and Evaluation, Alberta Health Services (AHS), CA.
  5. Robert Janke: University of British Columbia, Okanagan (UBCO), CA.
  6. Regina Rigatto Witt: School of Nursing, Universidade Federal do Rio Grande do Sul (UFRGS), BR.
  7. Cheryl Van Vliet-Brown: School of Nursing, University of British Columbia, Okanagan (UBCO), CA.
  8. Kaela Schill: School of Nursing, University of British Columbia, Okanagan (UBCO), CA.
  9. Mahnoush Rostami: Workforce Research and Evaluation, Alberta Health Services (AHS), CA.
  10. Shelanne Hepp: Workforce Research and Evaluation, Alberta Health Services (AHS), CA.
  11. Arden Birney: Workforce Research and Evaluation, Alberta Health Services (AHS), CA.
  12. Fatima Al-Roubaiai: British Columbia Patient Safety and Quality Council (BCPSQC), CA.
  13. Giselda Quintana Marques: School of Nursing, Universidade Federal do Rio Grande do Sul (UFRGS), BR.

Abstract

BACKGROUND: Despite far reaching support for integrated care, conceptualizing and measuring integrated care remains challenging. This knowledge synthesis aimed to identify indicator domains and tools to measure progress towards integrated care.
METHODS: We used an established framework and a Delphi survey with integration experts to identify relevant measurement domains. For each domain, we searched and reviewed the literature for relevant tools.
FINDINGS: From 7,133 abstracts, we retrieved 114 unique tools. We found many quality tools to measure care coordination, patient engagement and team effectiveness/performance. In contrast, there were few tools in the domains of performance measurement and information systems, alignment of organizational goals and resource allocation. The search yielded 12 tools that measure overall integration or three or more indicator domains.
DISCUSSION: Our findings highlight a continued gap in tools to measure foundational components that support integrated care. In the absence of such targeted tools, "overall integration" tools may be useful for a broad assessment of the overall state of a system.
CONCLUSIONS: Continued progress towards integrated care depends on our ability to evaluate the success of strategies across different levels and context. This study has identified 114 tools that measure integrated care across 16 domains, supporting efforts towards a unified measurement framework.

Keywords

References

  1. Med Care. 1999 Mar;37(3 Suppl):MS22-31 [PMID: 10098556]
  2. Hosp Health Serv Adm. 1993 Winter;38(4):467-89 [PMID: 10130608]
  3. J Healthc Manag. 1998 May-Jun;43(3):242-61; discussion 261-2 [PMID: 10181800]
  4. Pediatrics. 2000 Apr;105(4 Pt 2):998-1003 [PMID: 10742362]
  5. J Eval Clin Pract. 2001 Feb;7(1):71-9 [PMID: 11240841]
  6. Aust Fam Physician. 2001 Feb;30(2):182-8 [PMID: 11280122]
  7. Health Expect. 1998 Nov;1(2):82-95 [PMID: 11281863]
  8. Int J Qual Health Care. 2001 Apr;13(2):109-16 [PMID: 11430660]
  9. AIDS Public Policy J. 2000 Spring;15(1):29-42 [PMID: 11460293]
  10. AIDS Care. 2001 Oct;13(5):651-61 [PMID: 11571012]
  11. BMJ. 2001 Oct 20;323(7318):908-11 [PMID: 11668137]
  12. Qual Manag Health Care. 2002 Winter;10(2):1-11 [PMID: 11799825]
  13. Clin Nurs Res. 2001 Aug;10(3):314-31 [PMID: 11881945]
  14. Fam Pract. 2002 Jun;19(3):257-63 [PMID: 11978716]
  15. Behav Med. 2001 Fall;27(3):111-20 [PMID: 11985184]
  16. Health Serv Res. 2002 Jun;37(3):791-820 [PMID: 12132606]
  17. Jt Comm J Qual Improv. 2002 Sep;28(9):472-93 [PMID: 12216343]
  18. J Healthc Manag. 2002 Jul-Aug;47(4):250-61 [PMID: 12221746]
  19. Int J Qual Health Care. 2002 Oct;14(5):353-8 [PMID: 12389801]
  20. Qual Saf Health Care. 2003 Apr;12(2):93-9 [PMID: 12679504]
  21. Ambul Pediatr. 2003 Jul-Aug;3(4):173-80 [PMID: 12882594]
  22. Patient Educ Couns. 2003 Jul;50(3):311-22 [PMID: 12900105]
  23. Int J Qual Health Care. 2003 Aug;15(4):309-18 [PMID: 12930046]
  24. Arch Phys Med Rehabil. 2003 Sep;84(9):1332-8 [PMID: 13680570]
  25. Int J Geriatr Psychiatry. 2003 Oct;18(10):887-93 [PMID: 14533121]
  26. Med Care Res Rev. 2003 Dec;60(4 Suppl):95S-129S [PMID: 14687431]
  27. Med Care. 2004 May;42(5):472-81 [PMID: 15083108]
  28. J Behav Health Serv Res. 2004 Jul-Sep;31(3):279-96 [PMID: 15263867]
  29. J Stud Alcohol. 2004 Jul;65(4):513-20 [PMID: 15376826]
  30. Fam Pract. 2004 Dec;21(6):699-705 [PMID: 15528286]
  31. Med Care. 2005 Mar;43(3):246-55 [PMID: 15725981]
  32. Am J Hosp Palliat Care. 2005 Jan-Feb;22(1):26-31 [PMID: 15736604]
  33. Med Care. 2005 May;43(5):436-44 [PMID: 15838407]
  34. J Palliat Med. 2005 Aug;8(4):808-16 [PMID: 16128655]
  35. Health Care Manag (Frederick). 2005 Jul-Sep;24(3):216-24 [PMID: 16131931]
  36. Ann Fam Med. 2005 Sep-Oct;3(5):436-42 [PMID: 16189060]
  37. Int J Geriatr Psychiatry. 2006 Jan;21(1):77-85 [PMID: 16323254]
  38. Health Commun. 1998;10(3):261-88 [PMID: 16370986]
  39. J Gen Intern Med. 2006 Jan;21(1):13-21 [PMID: 16423118]
  40. Int J Integr Care. 2004;4:e03 [PMID: 16773145]
  41. Int J Integr Care. 2004;4:e05 [PMID: 16773147]
  42. Am J Health Promot. 2006 Jul-Aug;20(6):429-35 [PMID: 16871823]
  43. Patient Educ Couns. 2006 Nov;63(3):319-27 [PMID: 16872793]
  44. Int J Integr Care. 2002;2:e12 [PMID: 16896389]
  45. Int J Integr Care. 2002;2:e02 [PMID: 16896392]
  46. Can Fam Physician. 2005 Aug;51:1104-5 [PMID: 16926947]
  47. World J Surg. 2006 Oct;30(10):1774-83 [PMID: 16983480]
  48. Int J Geriatr Psychiatry. 2007 Mar;22(3):211-7 [PMID: 16988950]
  49. Head Neck. 2007 Apr;29(4):378-86 [PMID: 17123308]
  50. Med Educ. 2007 Feb;41(2):123-9 [PMID: 17269944]
  51. Eur J Cancer. 2007 May;43(8):1257-64 [PMID: 17467266]
  52. Health Serv Res. 2007 Jun;42(3 Pt 1):1235-56 [PMID: 17489912]
  53. Health Serv Manage Res. 2007 Aug;20(3):189-202 [PMID: 17683658]
  54. J Health Organ Manag. 2007;21(3):297-306 [PMID: 17713189]
  55. Int J Integr Care. 2007 Dec 03;7:e46 [PMID: 18074007]
  56. BMC Health Serv Res. 2007 Dec 17;7:204 [PMID: 18086304]
  57. Mil Med. 2008 Jan;173(1):85-90 [PMID: 18251337]
  58. Med Care. 2008 Mar;46(3):317-22 [PMID: 18388847]
  59. J Psychiatr Pract. 2008 May;14 Suppl 2:55-64 [PMID: 18677200]
  60. BMJ. 2008 Aug 07;337:a867 [PMID: 18687724]
  61. Med Care. 1991 Aug;29(8):709-26 [PMID: 1875739]
  62. Health Aff (Millwood). 2008 Sep-Oct;27(5):1246-58 [PMID: 18780907]
  63. J Gen Intern Med. 2009 Feb;24(2):162-9 [PMID: 19050977]
  64. Eur J Cancer. 2009 Jun;45(9):1569-77 [PMID: 19167212]
  65. Int J Integr Care. 2009;9:e01 [PMID: 19340325]
  66. Med Care. 2009 Jun;47(6):686-94 [PMID: 19433999]
  67. Patient Educ Couns. 2010 Jan;78(1):130-3 [PMID: 19560303]
  68. Int J Integr Care. 2009 Jun 17;9:e82 [PMID: 19590762]
  69. J Pediatr Psychol. 2011 Mar;36(2):160-71 [PMID: 20040605]
  70. Healthc Q. 2009;13 Spec No:16-23 [PMID: 20057244]
  71. Drug Alcohol Depend. 2009 Aug 1;103 Suppl 1:S54-S64 [PMID: 20088023]
  72. Patient Educ Couns. 2011 Jan;82(1):81-8 [PMID: 20219317]
  73. Cad Saude Publica. 2010 Mar;26(3):523-34 [PMID: 20464071]
  74. Soc Sci Med. 2010 Jul;71(2):394-399 [PMID: 20488603]
  75. Med Care Res Rev. 2011 Feb;68(1):112-27 [PMID: 20555018]
  76. Can Fam Physician. 2010 Aug;56(8):e308-14 [PMID: 20705870]
  77. Implement Sci. 2010 Sep 20;5:69 [PMID: 20854677]
  78. J Interprof Care. 2011 May;25(3):189-95 [PMID: 21182434]
  79. J Clin Oncol. 2011 Apr 1;29(10):1280-9 [PMID: 21357781]
  80. Int J Integr Care. 2011 Jan;11:e011 [PMID: 21637708]
  81. Implement Sci. 2011 Jul 27;6:83 [PMID: 21794144]
  82. PLoS Med. 2010 Aug;8(8):e1001069 [PMID: 21829330]
  83. J Gen Intern Med. 2011 Dec;26(12):1418-25 [PMID: 21837377]
  84. Stud Health Technol Inform. 2012;180:995-9 [PMID: 22874343]
  85. J Gen Intern Med. 1990 Jan-Feb;5(1):29-33 [PMID: 2299426]
  86. Health Aff (Millwood). 2012 Nov;31(11):2485-92 [PMID: 23129679]
  87. Med Care Res Rev. 2013 Apr;70(2):143-64 [PMID: 23161612]
  88. Int J Integr Care. 2011 Jul;11:e081 [PMID: 23390409]
  89. BMC Health Serv Res. 2013 Mar 28;13:119 [PMID: 23537350]
  90. J Clin Nurs. 2014 Feb;23(3-4):482-91 [PMID: 23551641]
  91. Int J Integr Care. 2012 Oct 01;12:e194 [PMID: 23593054]
  92. Int J Integr Care. 2013 Mar 22;13:e010 [PMID: 23687482]
  93. Int J Integr Care. 2013 Mar 22;13:e011 [PMID: 23687483]
  94. J Prim Care Community Health. 2010 Jul 1;1(2):88-92 [PMID: 23804368]
  95. Front Health Serv Manage. 2013 Summer;29(4):3-16 [PMID: 23858984]
  96. Qual Prim Care. 2013;21(3):149-55 [PMID: 23968264]
  97. Healthc Policy. 2013 May;8(4):56-70 [PMID: 23968638]
  98. Patient Educ Couns. 2013 Nov;93(2):265-71 [PMID: 24029581]
  99. Adm Policy Ment Health. 2014 Sep;41(5):668-86 [PMID: 24078060]
  100. Healthc Q. 2013;16(4):61-7 [PMID: 24485246]
  101. Int J Qual Health Care. 2014 Apr;26 Suppl 1:36-46 [PMID: 24615594]
  102. Int J Qual Health Care. 2014 Oct;26(5):561-70 [PMID: 25108537]
  103. Cad Saude Publica. 2014 Jul;30(7):1385-90 [PMID: 25166936]
  104. Health Aff (Millwood). 2014 Sep;33(9):1549-58 [PMID: 25201659]
  105. BMC Health Serv Res. 2014 Oct 04;14:479 [PMID: 25280467]
  106. Med Care. 2014 Dec;52(12):1037-41 [PMID: 25304020]
  107. J Oncol Pract. 2015 Jan;11(1):e36-43 [PMID: 25336082]
  108. Int J Integr Care. 2014 Sep 25;14:e027 [PMID: 25337064]
  109. J Interprof Care. 2015 May;29(3):245-52 [PMID: 25418319]
  110. Int J Integr Care. 2015 Mar 04;15:e003 [PMID: 25759607]
  111. BMC Fam Pract. 2015 Jul 22;16:87 [PMID: 26198100]
  112. Implement Sci. 2016 Nov 8;11(1):148 [PMID: 27821146]
  113. Milbank Q. 2016 Dec;94(4):862-917 [PMID: 27995711]
  114. Int J Integr Care. 2016 Oct 17;16(3):18 [PMID: 28435426]
  115. Health Care Manage Rev. 1994 Summer;19(3):7-20 [PMID: 7822193]
  116. Med Decis Making. 1995 Jan-Mar;15(1):25-30 [PMID: 7898294]
  117. Milbank Q. 1994;72(1):49-80 [PMID: 8164612]
  118. Arch Intern Med. 1996 Jul 8;156(13):1414-20 [PMID: 8678709]
  119. Med Decis Making. 1996 Jan-Mar;16(1):58-64 [PMID: 8717600]
  120. Dev Med Child Neurol. 1996 Sep;38(9):757-72 [PMID: 8810707]
  121. Milbank Q. 1996;74(4):511-44 [PMID: 8941260]
  122. Psychiatr Serv. 1997 Mar;48(3):374-80 [PMID: 9057241]
  123. J Fam Pract. 1997 Jul;45(1):64-74 [PMID: 9228916]
  124. Med Care. 1998 May;36(5):728-39 [PMID: 9596063]
  125. Br J Clin Psychol. 1998 May;37 ( Pt 2):155-72 [PMID: 9631204]
  126. Aust N Z J Psychiatry. 1998 Oct;32(5):666-72 [PMID: 9805589]

Word Cloud

Created with Highcharts 10.0.0toolscareintegrateddomainsmeasuremeasurementtowardssupportknowledgesynthesisidentifyindicatorprogressframeworkintegrationrelevant114performanceoverallacrossBACKGROUND:DespitefarreachingconceptualizingmeasuringremainschallengingaimedMETHODS:usedestablishedDelphisurveyexpertsdomainsearchedreviewedliteratureFINDINGS:7133abstractsretrieveduniquefoundmanyqualitycoordinationpatientengagementteameffectiveness/performancecontrastinformationsystemsalignmentorganizationalgoalsresourceallocationsearchyielded12threeDISCUSSION:findingshighlightcontinuedgapfoundationalcomponentsabsencetargeted"overallintegration"mayusefulbroadassessmentstatesystemCONCLUSIONS:Continueddependsabilityevaluatesuccessstrategiesdifferentlevelscontextstudyidentified16supportingeffortsunifiedIndicatorsMeasurementToolsHealthSystemsIntegration:KnowledgeSynthesisIntegrationinstruments

Similar Articles

Cited By