Synthesising quantitative and qualitative evidence to inform guidelines on complex interventions: clarifying the purposes, designs and outlining some methods.

Jane Noyes, Andrew Booth, Graham Moore, Kate Flemming, Özge Tunçalp, Elham Shakibazadeh
Author Information
  1. Jane Noyes: School of Social Sciences, Bangor University, Wales, UK. ORCID
  2. Andrew Booth: School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK. ORCID
  3. Graham Moore: School of Social Sciences, Cardiff University, Wales, UK.
  4. Kate Flemming: Department of Health Sciences, The University of York, York, UK. ORCID
  5. Özge Tunçalp: Department of Reproductive Health and Research including UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research Training in Human Reproduction (HRP), World Health Organization, Geneva, Switzerland.
  6. Elham Shakibazadeh: Department of Health Education and Promotion, School of Public Health, Tehran University of Medical Sciences, Tehran, Iran.

Abstract

Guideline developers are increasingly dealing with more difficult decisions concerning whether to recommend complex interventions in complex and highly variable health systems. There is greater recognition that both quantitative and qualitative evidence can be combined in a mixed-method synthesis and that this can be helpful in understanding how complexity impacts on interventions in specific contexts. This paper aims to clarify the different purposes, review designs, questions, synthesis methods and opportunities to combine quantitative and qualitative evidence to explore the complexity of complex interventions and health systems. Three case studies of guidelines developed by WHO, which incorporated quantitative and qualitative evidence, are used to illustrate possible uses of mixed-method reviews and evidence. Additional examples of methods that can be used or may have potential for use in a guideline process are outlined. Consideration is given to the opportunities for potential integration of quantitative and qualitative evidence at different stages of the review and guideline process. Encouragement is given to guideline commissioners and developers and review authors to consider including quantitative and qualitative evidence. Recommendations are made concerning the future development of methods to better address questions in systematic reviews and guidelines that adopt a complexity perspective.

Keywords

References

  1. BMC Med Res Methodol. 2013 Mar 13;13:37 [PMID: 23497061]
  2. BMJ. 2004 Apr 24;328(7446):1010-2 [PMID: 15105329]
  3. PLoS One. 2015 Nov 17;10(11):e0142187 [PMID: 26575182]
  4. Health Soc Care Community. 2015 Nov;23(6):577-93 [PMID: 25684035]
  5. Soc Sci Med. 2005 Jul;61(2):417-30 [PMID: 15893056]
  6. J Adv Nurs. 2016 Feb;72(2):461-80 [PMID: 26388106]
  7. BMC Med Res Methodol. 2008 Jul 10;8:45 [PMID: 18616818]
  8. BMJ Glob Health. 2019 Jan 25;4(Suppl 1):e000858 [PMID: 30775014]
  9. Pilot Feasibility Stud. 2015 Sep 7;1:32 [PMID: 27965810]
  10. BMJ. 2011 Oct 18;343:d5928 [PMID: 22008217]
  11. J Clin Epidemiol. 2018 May;97:59-69 [PMID: 29223325]
  12. Syst Rev. 2017 Mar 23;6(1):61 [PMID: 28335799]
  13. J Clin Epidemiol. 2012 Jul;65(7):756-63 [PMID: 22498429]
  14. J Clin Epidemiol. 2018 May;97:49-58 [PMID: 29247700]
  15. Lancet. 2002 Nov 16;360(9345):1596-9 [PMID: 12443615]
  16. BMJ Glob Health. 2019 Jan 25;4(Suppl 1):e000882 [PMID: 30775015]
  17. J Clin Epidemiol. 2016 May;73:29-35 [PMID: 26891948]
  18. Health Policy Plan. 2010 Mar;25(2):104-11 [PMID: 19917651]
  19. J Clin Epidemiol. 2017 Oct;90:11-18 [PMID: 28720514]
  20. J Clin Epidemiol. 2018 May;97:70-78 [PMID: 29242095]
  21. J Adv Nurs. 2010 Jan;66(1):201-17 [PMID: 20423445]
  22. BMJ. 2015 Mar 19;350:h1258 [PMID: 25791983]
  23. BMJ Glob Health. 2019 Jan 25;4(Suppl 1):e000899 [PMID: 30775017]
  24. J Clin Epidemiol. 2018 May;97:79-85 [PMID: 29222060]
  25. Soc Sci Med. 1995 Feb;40(4):459-68 [PMID: 7725120]
  26. BMJ Glob Health. 2019 Jan 25;4(Suppl 1):e000844 [PMID: 30775012]
  27. J Mix Methods Res. 2012 Oct;6(4):317-331 [PMID: 23066379]
  28. Evaluation (Lond). 2016 Jul;22(3):286-303 [PMID: 27478401]
  29. BMJ Glob Health. 2019 Jan 25;4(Suppl 1):e000848 [PMID: 30775013]
  30. Res Sch. 2006 Spring;13(1):29 [PMID: 20098638]
  31. Annu Rev Public Health. 2014;35:29-45 [PMID: 24188053]
  32. BMJ Glob Health. 2019 Jan 25;4(Suppl 1):e000840 [PMID: 30775011]
  33. Int J Qual Health Care. 2007 Dec;19(6):349-57 [PMID: 17872937]
  34. PLoS Med. 2015 Oct 27;12(10):e1001895 [PMID: 26506244]
  35. BMJ Glob Health. 2019 Jan 25;4(Suppl 1):e001107 [PMID: 30775019]
  36. BMC Med. 2011 Apr 14;9:39 [PMID: 21492447]
  37. J Public Health (Oxf). 2013 Mar;35(1):171-5 [PMID: 23436203]
  38. Health Technol Assess. 2014 Jun;18(38):1-197, v-vi [PMID: 24914457]
  39. Res Synth Methods. 2011 Mar;2(1):33-42 [PMID: 26061598]
  40. Health Policy Plan. 2015 Oct;30(8):1078-92 [PMID: 25288515]
  41. J Clin Epidemiol. 2016 Jul;75:78-92 [PMID: 26772607]
  42. Am J Public Health. 2004 Mar;94(3):400-5 [PMID: 14998803]
  43. J Clin Epidemiol. 2013 Nov;66(11):1230-43 [PMID: 23953082]

Grants

  1. 001/World Health Organization
  2. MR/K023233/1/Medical Research Council

Word Cloud

Created with Highcharts 10.0.0qualitativeevidencequantitativecomplexreviewmethodsinterventionshealthsystemscancomplexityguidelinesguidelinedevelopersconcerningmixed-methodsynthesisdifferentpurposesdesignsquestionsopportunitiesusedreviewspotentialprocessgivensystematicGuidelineincreasinglydealingdifficultdecisionswhetherrecommendhighlyvariablegreaterrecognitioncombinedhelpfulunderstandingimpactsspecificcontextspaperaimsclarifycombineexploreThreecasestudiesdevelopedWHOincorporatedillustratepossibleusesAdditionalexamplesmayuseoutlinedConsiderationintegrationstagesEncouragementcommissionersauthorsconsiderincludingRecommendationsmadefuturedevelopmentbetteraddressadoptperspectiveSynthesisinginforminterventions:clarifyingoutliningstudyrandomisedcontroltrial

Similar Articles

Cited By (153)