OpenLB
Open Library of Bioscience
Advanced Search
Trials
Nov 02, 2023;24 (1): 703.

Examining the impact of a universal social and emotional learning intervention (Passport) on internalising symptoms and other outcomes among children, compared to the usual school curriculum: study protocol for a school-based cluster randomised trial.

Annie O'Brien, Suzanne Hamilton, Neil Humphrey, Pamela Qualter, Jan R Boehnke, Joao Santos, Ola Demkowicz, Margarita Panayiotou, Alex Thompson, Jennifer Lau, Lauren Burke, Yizhuo Lu
Author Information
  1. Annie O'Brien: Manchester Institute of Education, The University of Manchester, Manchester, UK. ORCID
  2. Suzanne Hamilton: Manchester Institute of Education, The University of Manchester, Manchester, UK. suzanne.hamilton@manchester.ac.uk. ORCID
  3. Neil Humphrey: Manchester Institute of Education, The University of Manchester, Manchester, UK. ORCID
  4. Pamela Qualter: Manchester Institute of Education, The University of Manchester, Manchester, UK. ORCID
  5. Jan R Boehnke: School of Health Sciences, University of Dundee, Dundee, UK. ORCID
  6. Joao Santos: Manchester Institute of Education, The University of Manchester, Manchester, UK. ORCID
  7. Ola Demkowicz: Manchester Institute of Education, The University of Manchester, Manchester, UK. ORCID
  8. Margarita Panayiotou: Manchester Institute of Education, The University of Manchester, Manchester, UK. ORCID
  9. Alex Thompson: The Manchester Centre for Health Economics, The University of Manchester, Manchester, UK. ORCID
  10. Jennifer Lau: Youth Resilience Unit, Wolfson Institute of Population Health, Queen Mary, University of London, London, UK. ORCID
  11. Lauren Burke: Manchester Institute of Education, The University of Manchester, Manchester, UK. ORCID
  12. Yizhuo Lu: Manchester Institute of Education, The University of Manchester, Manchester, UK. ORCID
PMID: 37915094 DOI: 10.1186/s13063-023-07688-0

Abstract

BACKGROUND: School-based universal social and emotional learning (SEL) interventions implemented during the transition to adolescence may be efficacious in preventing the development of mental health difficulties. This protocol describes a two-arm parallel cluster randomised controlled trial to investigate the impact of a universal SEL intervention (Passport, compared to usual provision) on internalising symptoms (primary outcome), emotion regulation, well-being, loneliness, social support, bullying, academic attainment, and health-related quality of life in English primary school pupils aged 9-11 years. A developer-led trial demonstrated the feasibility, acceptability, and utility of Passport; this will be the first independent trial.
METHODS: Sixty primary schools will be recruited across the Greater Manchester city region and surrounding areas, involving 2400 pupils aged 8-9 at baseline. Schools will be allocated to the intervention arm to implement Passport over 18 weekly sessions or to the control arm to implement the usual school curriculum. Random allocation will be at school level following completion of baseline measures, with minimisation to ensure balance across trial arms in school size and free school meal eligibility. Measures will be collected at baseline, post-intervention (12 months post-baseline), and at 12 months follow-up (24 months post-baseline). The primary outcome analysis (intervention effects on internalising symptoms at post-intervention) will comprise a two-level (school, child) hierarchical linear model, following the intention-to-treat principle. Additional analyses will be undertaken to assess intervention effects on secondary outcomes, maintenance effects for all outcomes, intervention compliance moderator effects, subgroup moderator effects, and mechanisms underpinning intervention effects on the primary outcome. A mixed-methods implementation and process evaluation will examine factors that influence implementation, and a health economic evaluation will assess the cost-effectiveness of the intervention.
DISCUSSION: Findings will provide educators with crucial knowledge of whether and how increasing emotion regulation through a universal intervention impacts internalising symptoms and a range of related outcomes. Findings will also inform policy related to the promotion of mental health among children and young people. If the intervention is found to be efficacious in reducing internalising symptoms and is also cost-effective, it may offer high potential as a preventative intervention for widespread implementation.
TRIAL REGISTRATION: ISRCTN12875599; registered on 24 November 2022.

Keywords

Children Cluster randomised control trial Internalising symptoms Mental health School-based Social and emotional learning Universal intervention Well-being Young people

References

  1. Humphrey N. Are the kids alright? Psychol Educ Rev. 2018;42(3):4–12.
  2. Sellers R, Warne N, Pickles A, Maughan B, Thapar A, Collishaw S. Cross-cohort change in adolescent outcomes for children with mental health problems. J Child Psychol Psychiatr. 2019;60(7):813–21. [DOI: 10.1111/jcpp.13029]
  3. Sawyer SM, Azzopardi PS, Wickremarathne D, Patton GC. The age of adolescence. Lancet Child Adolesc Health. 2018;2(3):223–8. [PMID: 30169257]
  4. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication. Arch Gen Psychiatry. 2005;62(6):593. [PMID: 15939837]
  5. Vizard T, Sadler K, Ford T, Newlove-Delgado T, McManus S, Marcheselli F, et al. Mental health of children and young people in England, 2020. London: NHS Digital; 2020. Available from: https://files.digital.nhs.uk/AF/AECD6B/mhcyp_2020_rep_v2.pdf . Cited 2022 Dec 6.
  6. Kovacs M, Devlin B. Internalizing disorders in childhood. J Child Psychol Psychiat. 1998;39(1):47–63. [PMID: 9534086]
  7. Solmi M, Radua J, Olivola M, Croce E, Soardo L, Salazar de Pablo G, et al. Age at onset of mental disorders worldwide: large-scale meta-analysis of 192 epidemiological studies. Mol Psychiatry. 2022;27(1):281–95. [PMID: 34079068]
  8. Sadler K, Vizard T, Ford T, Marcheselli F, Pearce N, Mandalia D, et al. Mental health of children and young people in England, 2017. NHS Digital; 2018. Available from: https://digital.nhs.uk/data-and-information/publications/statistical/mental-health-of-children-and-young-people-in-england/2017/2017 . Cited 2022 Dec 5.
  9. Qualter P, Brown SL, Rotenberg KJ, Vanhalst J, Harris RA, Goossens L, et al. Trajectories of loneliness during childhood and adolescence: predictors and health outcomes. J Adolesc. 2013;36(6):1283–93. [PMID: 23465384]
  10. Loades ME, Chatburn E, Higson-Sweeney N, Reynolds S, Shafran R, Brigden A, et al. Rapid systematic review: the impact of social isolation and loneliness on the mental health of children and adolescents in the context of COVID-19. J Am Acad Child Adolesc Psychiatry. 2020;59(11):1218-1239.e3. [PMID: 32504808]
  11. Department of Health & Social Care. The Government’s response to the Health and Social Care Committee report: children and young people’s mental health. London: Dandy Booksellers Ltd; 2022. Available from: https://www.gov.uk/government/publications/children-and-young-peoples-mental-health-government-response/the-governments-response-to-the-health-and-social-care-committee-report-children-and-young-peoples-mental-health#introduction . Cited 2023 Jan 9.
  12. World Health Organization. Comprehensive mental health action plan 2013–2030. Geneva: World Health Organization; 2021. Available from: https://www.who.int/publications/i/item/9789240031029 . Cited 2023 Jan 9.
  13. Greenberg MT, Abenavoli R. Universal interventions: fully exploring their impacts and potential to produce population-level impacts. J Res Educ Effect. 2017;10(1):40–67.
  14. Humphrey N. Universal, school-based social and emotional learning interventions and their potential to improve students’ mental health. In: Handbook of school mental health: innovations in science and practice. 3rd. S.l. Springer International PU; 2023.
  15. HM Government. A strategy for tackling loneliness – laying the foundations for change. HM Government; 2018.
  16. CASEL. Core SEL competencies. 2020. Available from: https://casel.org/fundamentals-of-sel/what-is-the-casel-framework/#the-casel-5 . Cited 2023 Jan 11.
  17. Sklad M, Diekstra R, Ritter MD, Ben J, Gravesteijn C. Effectiveness of school-based universal social, emotional, and behavioral programs: do they enhance students’ development in the area of skill, behavior, and adjustment? Effects of social and emotional intervention programs. Psychol Schs. 2012;49(9):892–909. [DOI: 10.1002/pits.21641]
  18. Goodman A, Joshi H, Nasim B, Tyler C. Social and emotional skills in childhood and their long-term effects on adult life. Early Intervention Foundation; 2015.
  19. Durlak JA, Weissberg RP, Dymnicki AB, Taylor RD, Schellinger KB. The impact of enhancing students’ social and emotional learning: a meta-analysis of school-based universal interventions: social and emotional learning. Child Dev. 2011;82(1):405–32. [PMID: 21291449]
  20. Taylor RD, Oberle E, Durlak JA, Weissberg RP. Promoting positive youth development through school-based social and emotional learning interventions: a meta-analysis of follow-up effects. Child Dev. 2017;88(4):1156–71. [PMID: 28685826]
  21. Hennessey A, Qualter P, Humphrey N. The impact of promoting alternative thinking strategies (PATHS) on loneliness in primary school children: results from a randomized controlled trial in England. Front Educ. 2021;6:791438. [DOI: 10.3389/feduc.2021.791438]
  22. Partnership for Children. Passport: teaching coping and social skills for ages 9–11. Partnership for Children; 2019. Available from: https://www.partnershipforchildren.org.uk/what-we-do/programmes-for-schools/passport.html .
  23. Kato T. Testing of the coping flexibility hypothesis based on the dual-process theory: relationships between coping flexibility and depressive Symptoms. Psychiatry Res. 2015;230(2):137–42. [PMID: 26342281]
  24. Cheng C, Lau HPB, Chan MPS. Coping flexibility and psychological adjustment to stressful life changes: a meta-analytic review. Psychol Bull. 2014;140(6):1582–607. [PMID: 25222637]
  25. Zimmermann P, Iwanski A. Emotion regulation from early adolescence to emerging adulthood and middle adulthood: age differences, gender differences, and emotion-specific developmental variations. Int J Behav Dev. 2014;38(2):182–94. [DOI: 10.1177/0165025413515405]
  26. Demkowicz O, Panayiotou M, Qualter P, Humphrey N. Longitudinal relationships across emotional distress, perceived emotion regulation, and social connections during early adolescence: a developmental cascades investigation. Dev Psychopathol. 2023.
  27. Loevaas MES, Sund AM, Patras J, Martinsen K, Hjemdal O, Neumer SP, et al. Emotion regulation and its relation to symptoms of anxiety and depression in children aged 8–12 years: does parental gender play a differentiating role? BMC Psychol. 2018;6(1):42. [PMID: 30126444]
  28. Mishara BL, Dufour S. Randomized control study of the implementation and effects of a new mental health promotion program to improve coping skills in 9 to 11 year old children: Passport: skills for life. Front Psychol. 2020;11:573342. [PMID: 33192870]
  29. Humphrey N, Lendrum A, Ashworth E, Frearson K, Buck R, Kerr K. Implementation and process evaluation (IPE) for interventions in education settings: an introductory handbook. Education Endowment Foundation; 2016.
  30. Turner AJ, Sutton M, Harrison M, Hennessey A, Humphrey N. Cost-effectiveness of a school-based social and emotional learning intervention: evidence from a cluster-randomised controlled trial of the promoting alternative thinking strategies curriculum. Appl Health Econ Health Policy. 2020;18(2):271–85. [PMID: 31347016]
  31. Evans D, Coad J, Cottrell K, Dalrymple J, Davies R, Donald C, et al. Public involvement in research: assessing impact through a realist evaluation. Health Serv Del Res. 2014;2(36):1–128. [DOI: 10.3310/hsdr02360]
  32. Wigelsworth M, Squires G, Birchinall E, Kalambouka A, Lendrum A, Black L, et al. FRIENDS for life: evaluation report and executive summary. Education Endowment Foundation; 2018.
  33. Department for Education and Skills. Excellence and enjoyment: social and emotional aspects of learning (guidance). DfES Publications; 2005.
  34. Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Duer W, et al. KIDSCREEN-52 quality-of-life measure for children and adolescents. Expert Rev Pharmacoecon Outcomes Res. 2005;5(3):353–64. [PMID: 19807604]
  35. Zeman JL, Cassano M, Suveg C, Shipman K. Initial validation of the children’s worry management scale. J Child Fam Stud. 2010;19(4):381–92. [DOI: 10.1007/s10826-009-9308-4]
  36. Office for National Statistics. Measuring loneliness: guidance for use of the national indicators on surveys. Office for National Statistics; 2018. Available from: https://www.ons.gov.uk/peoplepopulationandcommunity/wellbeing/methodologies/measuringlonelinessguidanceforuseofthenationalindicatorsonsurveys#recommended-measures-for-children . Cited 2023 Jan 25.
  37. Ravens-Sieberer U, Auquier P, Erhart M, Gosch A, Rajmil L, Bruil J, et al. The KIDSCREEN-27 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries. Qual Life Res. 2007;16(8):1347–56. [PMID: 17668292]
  38. Stevens K, Ratcliffe J. Measuring and valuing health benefits for economic evaluation in adolescence: an assessment of the practicality and validity of the child health utility 9D in the Australian adolescent population. Value Health. 2012;15(8):1092–9. [PMID: 23244812]
  39. Carey EG, Ridler I, Ford TJ, Stringaris A. Editorial perspective: when is a ‘small effect’ actually large and impactful? Child Psychology Psychiatry. 2023:jcpp.13817.
  40. Bloom HS, Richburg-Hayes L, Black AR. Using covariates to improve precision for studies that randomize schools to evaluate educational interventions. Educ Eval Policy Anal. 2007;29(1):30–59. [DOI: 10.3102/0162373707299550]
  41. Hayes D, Moore A, Stapley E, Humphrey N, Mansfield R, Santos J, Ashworth E, Patalay P, Bonin E, Evans-Lacko S, Moltrecht B. School-based intervention study examining approaches for well-being and mental health literacy of pupils in Year 9 in England: study protocol for a multischool, parallel group cluster randomised controlled trial (AWARE). BMJ open. 2019;9(8):e029044.
  42. Humphrey N, Hennessey A, Troncoso P, Panayiotou M, Black L, Petersen K, et al. The Good Behaviour Game intervention to improve behavioural and other outcomes for children aged 7–8 years: a cluster RCT. Public Health Res. 2022;10(7):1–100. [DOI: 10.3310/VKOF7695]
  43. Saghaei M. MinimPy. 2020. Available from: Available from: http://sourceforge.net/projects/minimpy .
  44. Rotenberg KJ, Macdonald KJ, King EV. The relationship between loneliness and interpersonal trust during middle childhood. J Genet Psychol. 2004;165(3):233–49. [PMID: 15382815]
  45. Rotenberg KJ, Boulton MJ, Fox CL. Cross-sectional and longitudinal relations among children’s trust beliefs, psychological maladjustment and social relationships: are very high as well as very low trusting children at risk? J Abnorm Child Psychol. 2005;33(5):595–610. [PMID: 16195953]
  46. Wigelsworth M, Eccles A, Mason C, Verity L, Troncoso P, Qualter P, et al. Programmes to practices: results from a social & emotional school survey. Education Endowment Foundation; 2020.
  47. Domitrovich CE, Li Y, Mathis ET, Greenberg MT. Individual and organizational factors associated with teacher self-reported implementation of the PATHS curriculum. J Sch Psychol. 2019;76:168–85. [PMID: 31759464]
  48. Thierry KL, Vincent RL, Norris K. Teacher-level predictors of the fidelity of implementation of a social-emotional learning curriculum. Early Educ Dev. 2020;33(1):92–106. [DOI: 10.1080/10409289.2020.1849896]
  49. Brackett MA, Reyes MR, Rivers SE, Elbertson NA, Salovey P. Assessing teachers’ beliefs about social and emotional learning. J Psychoeduc Assess. 2012;30(3):219–36. [DOI: 10.1177/0734282911424879]
  50. Eddy CL, Herman KC, Reinke WM. Single-item teacher stress and coping measures: concurrent and predictive validity and sensitivity to change. J Sch Psychol. 2019;76:17–32. [PMID: 31759465]
  51. Tschannen-Moran M, Hoy AW. Teacher efficacy: capturing an elusive construct. Teach Teach Educ. 2001;17(7):783–805. [DOI: 10.1016/S0742-051X(01)00036-1]
  52. Chambers CD, Tzavella L. The past, present and future of Registered Reports. Nat Hum Behav. 2021;6(1):29–42. [PMID: 34782730]
  53. Muthén LK, Muthén BO. Mplus user’s guide. Los Angeles: Muthén & Muthén; 1998.
  54. R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2022. Available from: https://www.R-project.org/ .
  55. Braun V, Clarke V. One size fits all? What counts as quality practice in (reflexive) thematic analysis? Qual Res Psychol. 2021;18(3):328–52. [DOI: 10.1080/14780887.2020.1769238]
  56. Domitrovich CE, Bradshaw CP, Poduska JM, Hoagwood K, Buckley JA, Olin S, et al. Maximizing the implementation quality of evidence-based preventive interventions in schools: a conceptual framework. Adv School Ment Health Promot. 2008;1(3):6–28. [DOI: 10.1080/1754730X.2008.9715730]
  57. QSR International Pty Ltd. NVivo (Released in March 2020). 2020. Available from: https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home .
  58. Foulkes L, Stringaris A. Do no harm: can school mental health interventions cause iatrogenic harm? BJPsych Bull. 2023:1–3.
  59. Montero-Marin J, Allwood M, Ball S, Crane C, De Wilde K, Hinze V, et al. School-based mindfulness training in early adolescence: what works, for whom and how in the MYRIAD trial? BMJ Ment Health. 2022;25:117–24.
  60. Tanner-Smith EE, Durlak JA, Marx RA. Empirically based mean effect size distributions for universal prevention programs targeting school-aged youth: a review of meta-analyses. Prev Sci. 2018;19(8):1091–101. [PMID: 30136245]
  61. Peugh JL, Strotman D, McGrady M, Rausch J, Kashikar-Zuck S. Beyond intent to treat (ITT): a complier average causal effect (CACE) estimation primer. J Sch Psychol. 2017;60:7–24. [PMID: 28164801]
  62. Schmidt M, Werbrouck A, Verhaeghe N, Putman K, Simoens S, Annemans L. Universal mental health interventions for children and adolescents: a systematic review of health economic evaluations. Appl Health Econ Health Policy. 2020;18(2):155–75. [PMID: 31605299]

Grants

  1. Kavli2021-0000000019/Kavlifondet

MeSH Term

Adolescent
Humans
Child
Quality of Life
Schools
Emotions
Bullying
Cognition
Randomized Controlled Trials as Topic
Clinical Trial Protocol Journal Article
Article has an altmetric score of 11

Word Cloud

Created with Highcharts 10.0.0interventionwillschooltrialsymptomseffectsinternalisingprimaryuniversalhealthPassportoutcomessocialemotionallearningrandomisedusualoutcomebaselineimplementationSchool-basedSELmayefficaciousmentalprotocolclusterimpactcomparedemotionregulationpupilsagedacrossarmimplementcontrolfollowingpost-intervention12 monthspost-baselineassessmoderatorevaluationFindingsrelatedalsoamongchildrenpeopleBACKGROUND:interventionsimplementedtransitionadolescencepreventingdevelopmentdifficultiesdescribestwo-armparallelcontrolledinvestigateprovisionwell-beinglonelinesssupportbullyingacademicattainmenthealth-relatedqualitylifeEnglish9-11 yearsdeveloper-leddemonstratedfeasibilityacceptabilityutilityfirstindependentMETHODS:SixtyschoolsrecruitedGreaterManchestercityregionsurroundingareasinvolving24008-9Schoolsallocated18weeklysessionsto thecurriculumRandomallocationlevelcompletionmeasuresminimisationensurebalancearmssizefreemealeligibilityMeasurescollectedfollow-up24 monthsanalysiscomprisetwo-levelchildhierarchicallinearmodelintention-to-treatprincipleAdditionalanalysesundertakensecondarymaintenancecompliancesubgroupmechanismsunderpinningmixed-methodsprocessexaminefactorsinfluenceeconomiccost-effectivenessDISCUSSION:provideeducatorscrucialknowledgewhetherincreasingimpactsrangeinformpolicypromotionyoungfoundreducingcost-effectiveofferhighpotentialpreventativewidespreadTRIALREGISTRATION:ISRCTN12875599registered24November2022Examiningcurriculum:studyschool-basedChildrenClusterInternalisingMentalSocialUniversalWell-beingYoung

Similar Articles

Cited By