OpenLB
Open Library of Bioscience
Advanced Search
Administration and policy in mental health
Sep 13, 2024;

Outcomes that Matter to Youth and Families in Behavioral Health Services.

Genevieve Graaf, Katherine Kitchens, Millie Sweeney, Kathleen C Thomas
Author Information
  1. Genevieve Graaf: School of Social Work, The University of Texas at Arlington, Arlington, USA. genevieve.graaf@uta.edu. ORCID
  2. Katherine Kitchens: School of Social Work, The University of Texas at Arlington, Arlington, USA.
  3. Millie Sweeney: Family-Run Executive Director Leadership Association, Turner, USA.
  4. Kathleen C Thomas: Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, USA.
PMID: 39269533 DOI: 10.1007/s10488-024-01409-8

Abstract

Patient-centered outcomes research helps youth and families using behavioral health services make informed decisions about treatments to help them achieve the outcomes most important to them. However, there are few efforts to identify the outcomes valued by youth and families systematically. This project aimed to support the development of behavioral health services that deliver outcomes valued by families by identifying the outcomes that youth and young adults with behavioral health needs and caregivers say matter most to them. We engaged 34 youth and young adults (YYA) with behavioral health needs, alongside 42 caregivers from six U.S. regions, in two rounds of one-hour virtual focus groups. The initial round involved participants identifying what they hoped to gain from using behavioral health services for personal, familial, and parental or child well-being and the attributes of positive service experiences. We coded responses using qualitative analytical software, culminating in synthesized reports. Subsequently, the second round entailed participants' review and refinement of initial findings. Across sessions, each group reported the top three outcomes deemed most important for children, YYA, parents, families, and their service experiences. YYA identified being understood by others, improving their interpersonal relationships, and feeling heard as the highest priority behavioral health service outcomes. Caregivers of children and youth with behavioral health needs identified having accessible services that meet their needs, having providers that collaborate effectively with parents and other service systems, and experiencing consistent and continuous behavioral health care for their child as the most important behavioral health service outcomes. Both YYA with behavioral health needs and caregivers of children and youth prioritized gaining the necessary knowledge, resources, and tools to support their or their child's behavioral health. Additionally, both participant groups emphasized the importance of effective communication with providers, within their families, and with peers. Minimizing judgment and stigma from society, providers, and other professionals also emerged as a critical outcome for these groups. It is essential for research and policy development to focus on and cater to the outcomes that are important and valued by YYA and their families to maximize family engagement in care.

Keywords

Behavioral health service outcomes Child behavioral health services Patient-centered care Youth and family driven care

References

  1. Aarons, G. A., Covert, J., Skriner, L. C., Green, A., Marto, D., Garland, A. F., & Landsverk, J. (2010). The eye of the beholder: Youths and parents differ on what matters in mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 37(6), 459–467. https://doi.org/10.1007/s10488-010-0276-1 [DOI: 10.1007/s10488-010-0276-1]
  2. Anderson, C. (2010). Presenting and evaluating qualitative research. American Journal of Pharmaceutical Education, 74(8), 141. [DOI: 10.5688/aj7408141]
  3. Bieler, P., Bister, M. D., Hauer, J., Klausner, M., Niewöhner, J., Schmid, C., & von Peter, S. (2021). Distributing reflexivity through co-laborative ethnography. Journal of Contemporary Ethnography, 50(1), 77–98. https://doi.org/10.1177/0891241620968271 [DOI: 10.1177/0891241620968271]
  4. Coenen, M., Stamm, T. A., Stucki, G., & Cieza, A. (2012). Individual interviews and focus groups in patients with rheumatoid arthritis: A comparison of two qualitative methods. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment Care and Rehabilitation, 21(2), 359–370. https://doi.org/10.1007/s11136-011-9943-2 [DOI: 10.1007/s11136-011-9943-2]
  5. Coulter, A. (2017). Measuring what matters to patients. BMJ 356:j816. https://doi.org/10.1136/bmj.j816 .
  6. Crane, D. A., Lepicki, T., & Knudsen, K. (2016). Unique and common elements of the role of peer support in the context of traditional mental health services. Psychiatric Rehabilitation Journal, 39(3), 282–288. https://doi.org/10.1037/prj0000186 [DOI: 10.1037/prj0000186]
  7. DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Medical Care, 45(5 Suppl 1), S12–S21. https://doi.org/10.1097/01.mlr.0000254567.79743.e2 [DOI: 10.1097/01.mlr.0000254567.79743.e2]
  8. dosReis, S., Castillo, W. C., Ross, M., N’Dri, L., & Butler, B. (2018). Treatment outcome priorities for youth with multi-morbid mental health conditions: A latent class analysis of a best-worst scaling experiment. Value in Health, 21, S127. https://doi.org/10.1016/j.jval.2018.04.962 [DOI: 10.1016/j.jval.2018.04.962]
  9. Edbrooke-Childs, J., Jacob, J., Argent, R., Patalay, P., Deighton, J., & Wolpert, M. (2016). The relationship between child- and parent-reported shared decision making and child-, parent-, and clinician-reported treatment outcome in routinely collected child mental health services data. Clinical Child Psychology and Psychiatry, 21(2), 324–338. https://doi.org/10.1177/1359104515591226 [DOI: 10.1177/1359104515591226]
  10. Evans, S. C., Corteselli, K. A., Edelman, A., Scott, H., & Weisz, J. R. (2023). Is irritability a top problem in youth mental health care? A multi-informant, multi-method investigation. Child Psychiatry & Human Development, 54(4), 1027–1041. https://doi.org/10.1007/s10578-021-01301-8 [DOI: 10.1007/s10578-021-01301-8]
  11. Garland, A. F., Lewczyk-Boxmeyer, C. M., Gabayan, E. N., & Hawley, K. M. (2004). Multiple stakeholder agreement on desired outcomes for adolescents’ mental health services. Psychiatric Services, 55(6), 671–676. https://doi.org/10.1176/appi.ps.55.6.671 [DOI: 10.1176/appi.ps.55.6.671]
  12. Gibson, K., & Cartwright, C. (2014). Young clients’ narratives of the purpose and outcome of counselling. British Journal of Guidance & Counselling, 42(5), 511–524. https://doi.org/10.1080/03069885.2014.925084 [DOI: 10.1080/03069885.2014.925084]
  13. Gibson, K., Cartwright, C., Kerrisk, K., Campbell, J., & Seymour, F. (2016). What young people want: A qualitative study of adolescents’ priorities for engagement across psychological services. Journal of Child and Family Studies, 25(4), 1057–1065. https://doi.org/10.1007/s10826-015-0292-6 [DOI: 10.1007/s10826-015-0292-6]
  14. Graaf, G., Kitchens, K., Sweeney, M., & Thomas, K. (In Progress). Behavioral health services outcomes that matter most to youth and young adults with mental health needs.
  15. Graaf, G, Kitchens K, Sweeney M, & Thomas, K. C. (2024). Behavioral health services outcomes that matter most to caregivers of children, youth, and young adults with mental health needs. International Journal of Environmental Research and Public Health 21, 2:172. https://doi.org/10.3390/ijerph21020172
  16. Graaf, G., & Snowden, L. (2020). State strategies for enhancing access and quality in systems of care for youth with complex behavioral health needs. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-020-01061-y [DOI: 10.1007/s10488-020-01061-y]
  17. Greene, S. M., Tuzzio, L., & Cherkin, D. (2012). A framework for making patient-centered care front and center. The Permanente Journal, 16(3), 49–53. [DOI: 10.7812/TPP/12-025]
  18. Guest, G., Namey, E., & McKenna, K. (2017). How many focus groups are enough? Building an evidence base for nonprobability sample sizes. Field Methods, 29(1), 3–22. https://doi.org/10.1177/1525822X16639015 [DOI: 10.1177/1525822X16639015]
  19. Hawley, K. M., & Weisz, J. R. (2003). Child, parent and therapist (dis)agreement on target problems in outpatient therapy: The therapist’s dilemma and its implications. Journal of Consulting and Clinical Psychology, 71(1), 62–70. https://doi.org/10.1037/0022-006X.71.1.62 [DOI: 10.1037/0022-006X.71.1.62]
  20. Hawley, K. M., & Weisz, J. R. (2005). Youth versus parent working alliance in usual clinical care: Distinctive associations with retention, satisfaction, and treatment outcome. Journal of Clinical Child & Adolescent Psychology, 34(1), 117–128. https://doi.org/10.1207/s15374424jccp3401_11 [DOI: 10.1207/s15374424jccp3401_11]
  21. Hennink, M. M., Kaiser, B. N., & Weber, M. B. (2019). What influences saturation? Estimating sample sizes in focus group research. Qualitative Health Research, 29(10), 1483–1496. https://doi.org/10.1177/1049732318821692 [DOI: 10.1177/1049732318821692]
  22. Hoagwood, K., Jensen, P., Petti, T., & Burns, B. (1996). Outcomes of mental health care for children and adolescents: I. A comprehensive conceptual model. Journal of the American Academy of Child & Adolescent Psychiatry, 35(8), 1055–1063. https://doi.org/10.1097/00004583-199608000-00017 [DOI: 10.1097/00004583-199608000-00017]
  23. Hoagwood, K. E., Green, E., Kelleher, K., Schoenwald, S., Rolls-Reutz, J., Landsverk, J., Glisson, C., & Mayberg, S. (2008). Family advocacy, support and education in children’s mental health: Results of a national survey. Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 73–83. https://doi.org/10.1007/s10488-007-0149-4 [DOI: 10.1007/s10488-007-0149-4]
  24. Hoagwood, K. E., Jensen, P. S., Acri, M. C., Olin, S., Lewandowski, S. E., R., & Herman, R. J. (2012). Have they changed and why does it matter? Journal of the American Academy of Child & Adolescent Psychiatry, 51(12), 1241–1260e2. https://doi.org/10.1016/j.jaac.2012.09.004 . Outcome domains in child mental health research since 1996.
  25. Houston, R., Smithey, A., & Brykman, K. (2022). Medicaid Population-Based Payment: The Current Landscape, Early Insights, and Considerations for Policymakers. Center for Healthcare Strategies. https://www.chcs.org/resource/medicaid-population-based-payment-the-current-landscape-early-insights-and-considerations-for-policymakers/
  26. Huang, L., Stroul, B., Friedman, R., Mrazek, P., Friesen, B., Pires, S., & Mayberg, S. (2005). Transforming mental health care for children and their families. American Psychologist, 60(6), 615–627. https://doi.org/10.1037/0003-066X.60.6.615 [DOI: 10.1037/0003-066X.60.6.615]
  27. Hyatt, A. S., Tepper, M. C., & O’Brien, C. J. (2021). Recognizing and seizing the opportunities that value-based payment models offer behavioral health care. Psychiatric Services, 72(6), 732–735. https://doi.org/10.1176/appi.ps.202000044 [DOI: 10.1176/appi.ps.202000044]
  28. Jacob, J., Edbrooke-Childs, J., Holley, S., Law, D., & Wolpert, M. (2016). Horses for courses? A qualitative exploration of goals formulated in mental health settings by young people, parents, and clinicians. Clinical Child Psychology and Psychiatry, 21(2), 208–223. https://doi.org/10.1177/1359104515577487 [DOI: 10.1177/1359104515577487]
  29. Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62(6), 593–602. https://doi.org/10.1001/archpsyc.62.6.593 [DOI: 10.1001/archpsyc.62.6.593]
  30. King, A. J., & Simmons, M. B. (2018). A systematic review of the attributes and outcomes of peer work and guidelines for reporting studies of peer interventions. Psychiatric Services, 69(9), 961–977. https://doi.org/10.1176/appi.ps.201700564 [DOI: 10.1176/appi.ps.201700564]
  31. Kitson, A., Marshall, A., Bassett, K., & Zeitz, K. (2013). What are the core elements of patient-centred care? A narrative review and synthesis of the literature from health policy, medicine and nursing. Journal of Advanced Nursing, 69(1), 4–15. https://doi.org/10.1111/j.1365-2648.2012.06064.x [DOI: 10.1111/j.1365-2648.2012.06064.x]
  32. Krause, K. R., Bear, H. A., Edbrooke-Childs, J., & Wolpert, M. (2018). What outcomes count? A review of outcomes measured for adolescent depression between 2007 and 2017. Journal of the American Academy of Child & Adolescent Psychiatry. https://doi.org/10.1016/j.jaac.2018.07.893 [DOI: 10.1016/j.jaac.2018.07.893]
  33. Krause, K., Midgley, N., Edbrooke-Childs, J., & Wolpert, M. (2021). A comprehensive mapping of outcomes following psychotherapy for adolescent depression: The perspectives of young people, their parents and therapists. European Child & Adolescent Psychiatry, 30(11), 1779–1791. https://doi.org/10.1007/s00787-020-01648-8 [DOI: 10.1007/s00787-020-01648-8]
  34. Lutterman, T., Ganju, V., Schacht, L., Shaw, R., Monihan, K. (2003). Sixteen State Study on Performance Measures. Center for Mental Health Services, Substance Abuse and Mental Health Services Administration. http://psbqi.dmh.lacounty.gov/QI/Report_Final/Sixteen%20State%20Study%20on%20Mental%20Health%20Performance%20Measures%202003.pdf
  35. Mechanic, D. (2012). Seizing opportunities under the Affordable Care Act for transforming the mental and behavioral health system. Health Affairs (Project Hope), 31(2), 376–382. https://doi.org/10.1377/hlthaff.2011.0623 [DOI: 10.1377/hlthaff.2011.0623]
  36. Miles, M. B., Huberman, A. M., & Saldaña, J. (2013). Qualitative Data Analysis: A Methods Sourcebook (Third Edition edition). SAGE Publications, Inc.
  37. Narendorf, S. C., Wagner, R., Fedoravicius, N., & Washburn, M. (2017). Prior experiences of behavioral health treatment among uninsured young adults served in a psychiatric crisis setting. Community Mental Health Journal, 53(7), 782–792. https://doi.org/10.1007/s10597-017-0150-7 [DOI: 10.1007/s10597-017-0150-7]
  38. Olmos-Vega, F. M., Stalmeijer, R. E., Varpio, L., & Kahlke, R. (2023). A practical guide to reflexivity in qualitative research: AMEE Guide 149. Medical Teacher, 45(3), 241–251. https://doi.org/10.1080/0142159X.2022.2057287 [DOI: 10.1080/0142159X.2022.2057287]
  39. Ross, M., Bridges, J. F. P., Ng, X., Wagner, L. D., Frosch, E., Reeves, G., & dosReis, S. (2015). A best-worst scaling experiment to prioritize caregiver concerns about ADHD medication for children. Psychiatric Services, 66(2), 208–211. https://doi.org/10.1176/appi.ps.201300525 [DOI: 10.1176/appi.ps.201300525]
  40. Saldaña, J., & H62.S. (2013). The coding manual for qualitative researchers (Social Research 343 2013). Los Angeles, Thousand Oaks, CA : SAGE Publications, 2013.
  41. Stroul, B. A., Blau, G. M., & Larson, J. (2021). The Evolution of the System of Care Approach (p. 27).
  42. The Lancet Psychiatry. (2020). Measuring success: The problem with primary outcomes. The Lancet Psychiatry, 7(1), 1. https://doi.org/10.1016/S2215-0366(19)30483-3 [DOI: 10.1016/S2215-0366(19)30483-3]
  43. Varpio, L., Ajjawi, R., Monrouxe, L. V., O’Brien, B. C., & Rees, C. E. (2017). Shedding the cobra effect: Problematising thematic emergence, triangulation, saturation and member checking. Medical Education, 51(1), 40–50. https://doi.org/10.1111/medu.13124 [DOI: 10.1111/medu.13124]
  44. VERBI Software. (2021). MAXQDA 2022 [Computer software]. VERBI Software. www.maxqda.com.
  45. Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work. Routledge.
  46. Weisz, J. R., Chorpita, B. F., Frye, A., Ng, M. Y., Lau, N., Bearman, S. K., Ugueto, A. M., Langer, D. A., & Hoagwood, K. E. (2011). Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79(3), 369–380. https://doi.org/10.1037/a0023307 [DOI: 10.1037/a0023307]
  47. Wilens, T. E., & Rosenbaum, J. F. (2013). Transitional aged youth: A new frontier in child and adolescent psychiatry. Journal of the American Academy of Child and Adolescent Psychiatry, 52(9), 887–890. https://doi.org/10.1016/j.jaac.2013.04.020 [DOI: 10.1016/j.jaac.2013.04.020]
  48. Williams, N. J., Beauchemin, J., Griffis, J., & Marcus, S. C. (2023). Disparities in youth and family experiences of system-of-care principles by level of youth need. Community Mental Health Journal, 59(7), 1388–1400. https://doi.org/10.1007/s10597-023-01126-w [DOI: 10.1007/s10597-023-01126-w]
  49. Zima, B. T., Edgcomb, J. B., & Shugarman, S. A. (2019). National child mental health quality measures: Adherence rates and extent of evidence for clinical validity. Current Psychiatry Reports, 21(1), 6. https://doi.org/10.1007/s11920-019-0986-3 [DOI: 10.1007/s11920-019-0986-3]

Grants

  1. EASCS-24854/Patient-Centered Outcomes Research Institute
  2. 1K01MH129991/NIMH NIH HHS
Journal Article

Word Cloud

Created with Highcharts 10.0.0healthbehavioraloutcomesyouthfamiliesserviceservicesneedsYYAimportantcareusingvaluedcaregiversgroupschildrenprovidersPatient-centeredresearchsupportdevelopmentidentifyingyoungadultsfocusinitialroundchildexperiencesparentsidentifiedfamilyYouthBehavioralhelpsmakeinformeddecisionstreatmentshelpachieveHowevereffortsidentifysystematicallyprojectaimeddeliversaymatterengaged34alongside42sixUSregionstworoundsone-hourvirtualinvolvedparticipantshopedgainpersonalfamilialparentalwell-beingattributespositivecodedresponsesqualitativeanalyticalsoftwareculminatingsynthesizedreportsSubsequentlysecondentailedparticipants'reviewrefinementfindingsAcrosssessionsgroupreportedtopthreedeemedunderstoodothersimprovinginterpersonalrelationshipsfeelingheardhighestpriorityCaregiversaccessiblemeetcollaborateeffectivelysystemsexperiencingconsistentcontinuousprioritizedgainingnecessaryknowledgeresourcestoolschild'sAdditionallyparticipantemphasizedimportanceeffectivecommunicationwithinpeersMinimizingjudgmentstigmasocietyprofessionalsalsoemergedcriticaloutcomeessentialpolicycatermaximizeengagementOutcomesMatterFamiliesHealthServicesChilddriven

Similar Articles

Cited By (1)