A Systematic Review of External Validity in Pediatric Integrated Primary Care Trials.

Alicia Callejo-Black, David V Wagner, Krishnapriya Ramanujam, Ann Jeline Manabat, Sarah Mastel, Andrew R Riley
Author Information
  1. Alicia Callejo-Black: School of Medicine, University of California-San Diego.
  2. David V Wagner: Department of Pediatrics, Institute on Development & Disability, Oregon Health & Science University, Portland, Oregon.
  3. Krishnapriya Ramanujam: Department of Pediatrics, Institute on Development & Disability, Oregon Health & Science University, Portland, Oregon.
  4. Ann Jeline Manabat: Portland State University.
  5. Sarah Mastel: Department of Pediatrics, Institute on Development & Disability, Oregon Health & Science University, Portland, Oregon.
  6. Andrew R Riley: Department of Pediatrics, Institute on Development & Disability, Oregon Health & Science University, Portland, Oregon.

Abstract

OBJECTIVE: We used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to conduct a systematic review of external validity reporting in integrated primary care (IPC) interventions for mental health concerns.
METHODS: We searched Medline, CINAHL, PsycINFO, the Cochrane Center Register of Controlled Trials, and relevant literature to identify publications from 1998 to 2018 reporting on open, randomized, or quasi-randomized trials of IPC interventions that targeted child (ages 0-18 years) psychological symptoms. For each publication, we extracted the information reported in each RE-AIM domain and calculated the proportion of the total studies reviewed.
RESULTS: Thirty-nine publications describing 25 studies were included in the review. Publications rarely reported some indicators of external validity, including the representativeness of participants (12%), rate of adoption clinics or providers (16%), cost of implementation (8%), or evidence of maintenance (16%). Few studies reported on key pragmatic factors such as cost or organizational change processes related to implementation and maintenance. Strengths of some studies included comparisons of multiple active treatments, use of tailorable interventions, and implementation in "real world" settings.
CONCLUSIONS: Although IPC interventions appear efficacious under research conditions, there are significant knowledge gaps regarding the degree to which they reach and engage target recipients, what factors impact adoption and implementation of IPC interventions by clinicians, how fidelity can be maintained over time, and cost-effectiveness. Pediatric IPC researchers should embrace dissemination and implementation science methods to balance internal and external validity concerns moving forward.

Keywords

References

  1. Arch Dis Child. 2002 Dec;87(6):472-7 [PMID: 12456542]
  2. J Pediatr Psychol. 2008 Jun;33(5):462-72 [PMID: 17956931]
  3. JAMA Pediatr. 2014 Jan;168(1):16-24 [PMID: 24190691]
  4. Psychiatr Serv. 2009 Oct;60(10):1357-64 [PMID: 19797376]
  5. J Community Psychol. 2020 May;48(4):1178-1193 [PMID: 31951291]
  6. Am J Public Health. 1999 Sep;89(9):1322-7 [PMID: 10474547]
  7. J Pediatr Psychol. 2016 Nov;41(10):1161-1164 [PMID: 27562346]
  8. BMC Med. 2013 Nov 11;11:240 [PMID: 24207163]
  9. BMC Health Serv Res. 2018 Mar 13;18(1):177 [PMID: 29534729]
  10. J Med Internet Res. 2019 Apr 11;21(4):e11446 [PMID: 30973337]
  11. JAMA. 2014 Aug 27;312(8):809-16 [PMID: 25157724]
  12. J Pediatr Psychol. 2008 Jun;33(5):449-61 [PMID: 17956932]
  13. Am Psychol. 2017 Jan;72(1):13-27 [PMID: 28068135]
  14. J Healthc Manag. 2004 May-Jun;49(3):155-68; discussion 169-70 [PMID: 15190858]
  15. PLoS Med. 2009 Jul 21;6(7):e1000097 [PMID: 19621072]
  16. Fam Syst Health. 2017 Mar;35(1):46-57 [PMID: 28333516]
  17. Trauma Violence Abuse. 2020 Oct;21(4):706-724 [PMID: 30064299]
  18. Pediatrics. 2014 Apr;133(4):e981-92 [PMID: 24664093]
  19. Ann Fam Med. 2004 Jan-Feb;2(1):4-6 [PMID: 15053276]
  20. Pediatrics. 2015 Apr;135(4):e858-67 [PMID: 25802346]
  21. Gen Hosp Psychiatry. 2009 Jan-Feb;31(1):36-45 [PMID: 19134509]
  22. Am J Psychiatry. 2009 Sep;166(9):1002-10 [PMID: 19651711]
  23. Fam Syst Health. 2020 Jun;38(2):139-150 [PMID: 32297758]
  24. Fam Syst Health. 2020 Mar;38(1):16-23 [PMID: 32202831]
  25. Arch Dis Child. 2004 Jun;89(6):519-25 [PMID: 15155394]
  26. J Pediatr Psychol. 2017 Oct 1;42(9):1051-1064 [PMID: 28369443]
  27. Child Psychiatry Hum Dev. 2010 Feb;41(1):114-31 [PMID: 19697120]
  28. J Child Fam Stud. 2010 Oct 1;19(5):629-645 [PMID: 20823946]
  29. Pediatrics. 2018 Apr 9;: [PMID: 29632256]
  30. Contemp Clin Trials. 2016 Sep;50:229-37 [PMID: 27592122]
  31. Arch Pediatr Adolesc Med. 2012 Mar;166(3):224-31 [PMID: 22064876]
  32. Pediatrics. 2011 Aug;128(2):356-63 [PMID: 21727101]
  33. Fam Pract. 2008 Dec;25 Suppl 1:i20-4 [PMID: 18794201]
  34. J Consult Clin Psychol. 2014 Dec;82(6):1193-200 [PMID: 24979315]
  35. Pediatrics. 2019 Apr;143(4): [PMID: 30877145]
  36. Am J Prev Med. 2016 Oct;51(4 Suppl 2):S106-18 [PMID: 27498167]
  37. Ann Fam Med. 2009 Nov-Dec;7(6):547-54 [PMID: 19901315]
  38. Pediatrics. 2017 Jan;139(1): [PMID: 27965378]
  39. Implement Sci. 2009 Aug 07;4:50 [PMID: 19664226]
  40. Fam Syst Health. 2018 Mar;36(1):108-112 [PMID: 29172627]
  41. J Pediatr Health Care. 2011 Mar-Apr;25(2):77-86 [PMID: 21320679]
  42. Med Care. 2012 Mar;50(3):217-26 [PMID: 22310560]
  43. Behav Ther. 2010 Jun;41(2):198-211 [PMID: 20412885]
  44. Syst Rev. 2015 Nov 08;4:155 [PMID: 26547687]
  45. Behav Ther. 2010 Sep;41(3):375-87 [PMID: 20569786]
  46. J Abnorm Child Psychol. 2006 Apr;34(2):203-219 [PMID: 16741684]
  47. JAMA. 2005 Jan 19;293(3):311-9 [PMID: 15657324]
  48. J Child Adolesc Psychopharmacol. 2012 Feb;22(1):80-90 [PMID: 22251025]
  49. Pediatrics. 2004 Oct;114(4):e392-9 [PMID: 15466063]
  50. Ann Behav Med. 2005 Apr;29 Suppl:66-75 [PMID: 15921491]
  51. J Pediatr Psychol. 2019 Oct 1;44(9):1068-1073 [PMID: 31045228]
  52. Prev Sci. 2017 Apr;18(3):305-311 [PMID: 27469458]
  53. J Am Acad Child Adolesc Psychiatry. 2018 Sep;57(9):658-668.e1 [PMID: 30196869]
  54. JAMA Psychiatry. 2017 Jun 1;74(6):571-578 [PMID: 28423145]
  55. JAMA Pediatr. 2015 Oct;169(10):929-37 [PMID: 26259143]
  56. Fam Pract. 2019 Oct 8;36(5):666-671 [PMID: 30888015]
  57. J Pediatr Psychol. 2009 Aug;34(7):760-8 [PMID: 19064608]
  58. BMJ. 2011 Oct 18;343:d5928 [PMID: 22008217]
  59. JAMA Psychiatry. 2016 Apr;73(4):378-87 [PMID: 26913614]
  60. Br J Clin Psychol. 2004 Nov;43(Pt 4):449-57 [PMID: 15530214]
  61. J Subst Abuse Treat. 2011 Sep;41(2):148-55 [PMID: 21489741]
  62. Fam Syst Health. 2016 Dec;34(4):414-423 [PMID: 27831698]
  63. J Am Acad Child Adolesc Psychiatry. 2005 Sep;44(9):888-98 [PMID: 16113617]
  64. Fam Pract. 2013 Feb;30(1):14-24 [PMID: 22948337]
  65. Behav Res Ther. 2015 Dec;75:32-9 [PMID: 26523886]
  66. JAMA Pediatr. 2016 Nov 1;170(11):1048-1054 [PMID: 27654449]
  67. J Dev Behav Pediatr. 2010 Jun;31(5):393-404 [PMID: 20495474]

Grants

  1. K12 HS022981/AHRQ HHS
  2. RL5 GM118963/NIGMS NIH HHS
  3. TL4 GM118965/NIGMS NIH HHS
  4. UL1 GM118964/NIGMS NIH HHS

MeSH Term

Adolescent
Child
Child, Preschool
Cost-Benefit Analysis
Humans
Infant
Infant, Newborn
Mental Health
Primary Health Care

Word Cloud

Created with Highcharts 10.0.0IPCinterventionsimplementationstudiesreviewexternalvaliditycarereportedRE-AIMsystematicreportingintegratedprimarymentalhealthconcernsTrialspublicationsincludedadoption16%costmaintenancefactorsresearchPediatricmethodsOBJECTIVE:usedReachEffectivenessAdoptionImplementationMaintenanceframeworkconductMETHODS:searchedMedlineCINAHLPsycINFOCochraneCenterRegisterControlledrelevantliteratureidentify19982018openrandomizedquasi-randomizedtrialstargetedchildages0-18 yearspsychologicalsymptomspublicationextractedinformationdomaincalculatedproportiontotalreviewedRESULTS:Thirty-ninedescribing25Publicationsrarelyindicatorsincludingrepresentativenessparticipants12%rateclinicsproviders8%evidencekeypragmaticorganizationalchangeprocessesrelatedStrengthscomparisonsmultipleactivetreatmentsusetailorable"realworld"settingsCONCLUSIONS:Althoughappearefficaciousconditionssignificantknowledgegapsregardingdegreereachengagetargetrecipientsimpactcliniciansfidelitycanmaintainedtimecost-effectivenessresearchersembracedisseminationsciencebalanceinternalmovingforwardSystematicReviewExternalValidityIntegratedPrimaryCarehealthcareservicesdesigns

Similar Articles

Cited By (1)