Assessment of School Anti-Bullying Interventions: A Meta-analysis of Randomized Clinical Trials.

David Fraguas, Covadonga M Díaz-Caneja, Miriam Ayora, Manuel Durán-Cutilla, Renzo Abregú-Crespo, Iciar Ezquiaga-Bravo, Javier Martín-Babarro, Celso Arango
Author Information
  1. David Fraguas: Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), School of Medicine, Universidad Complutense, Madrid, Spain.
  2. Covadonga M Díaz-Caneja: Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), School of Medicine, Universidad Complutense, Madrid, Spain.
  3. Miriam Ayora: Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), School of Medicine, Universidad Complutense, Madrid, Spain.
  4. Manuel Durán-Cutilla: Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), School of Medicine, Universidad Complutense, Madrid, Spain.
  5. Renzo Abregú-Crespo: Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), School of Medicine, Universidad Complutense, Madrid, Spain.
  6. Iciar Ezquiaga-Bravo: Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), School of Medicine, Universidad Complutense, Madrid, Spain.
  7. Javier Martín-Babarro: Department of Developmental Psychology and Education, Universidad Complutense, Madrid, Spain.
  8. Celso Arango: Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), School of Medicine, Universidad Complutense, Madrid, Spain.

Abstract

Importance: bullying is a prevalent and modifiable risk factor for mental health disorders. Although previous studies have supported the effectiveness of anti-bullying programs; their population impact and the association of specific moderators with outcomes are still unclear.
Objective: To assess the effectiveness of school anti-bullying interventions, their population impact, and the association between moderator variables and outcomes.
Data Sources: A search of Ovid MEDLINE, ERIC, and PsycInfo databases was conducted using 3 sets of search terms to identify randomized clinical trials (RCTs) assessing anti-bullying interventions published from database inception through February 2020. A manual search of reference lists of articles included in previous systematic reviews and meta-analyses was also performed.
Study Selection: The initial literature search yielded 34 798 studies. Included in the study were articles that (1) assessed bullying at school; (2) assessed the effectiveness of an anti-bullying program; (3) had an RCT design; (4) reported results; and (5) were published in English. Of 16 707 studies identified, 371 met the criteria for review of full-text articles; 77 RCTs were identified that reported data allowing calculation of effect sizes (ESs). Of these, 69 independent trials were included in the final meta-analysis database.
Data Extraction and Synthesis: Random-effects and meta-regression models were used to derive Cohen d values with pooled 95% CIs as estimates of ES and to test associations between moderator variables and ES estimates. Population impact number (PIN), defined as the number of children in the total population for whom 1 event may be prevented by an intervention, was used as an estimate of the population impact of universal interventions targeting all students, regardless of individual risk.
Main Outcomes and Measures: The main outcomes are the effectiveness (measured by ES) and the population impact (measured by the PIN) of anti-bullying interventions on the following 8 variable categories: overall bullying, bullying perpetration, bullying exposure, cyberbullying, attitudes that discourage bullying, attitudes that encourage bullying, mental health problems (eg, anxiety and depression), and school climate as well as the assessment of potential assocations between trial or intervention characteristics and outcomes.
Results: This study included 77 samples from 69 RCTs (111 659 participants [56 511 in the intervention group and 55 148 in the control group]). The weighted mean (range) age of participants in the intervention group was 11.1 (4-17) years and 10.8 (4-17) years in the control group. The weighted mean (range) proportion of female participants in the intervention group was 49.9% (0%-100%) and 50.5% (0%-100%) in the control group. Anti-bullying interventions were efficacious in reducing bullying (ES, -0.150; 95% CI, -0.191 to -0.109) and improving mental health problems (ES, -0.205; 95% CI, -0.277 to -0.133) at study end point, with PINs for universal interventions that target the total student population of 147 (95% CI, 113-213) and 107 (95% CI, 73-173), respectively. Duration of intervention was not statistically significantly associated with intervention effectiveness (mean [range] duration of interventions, 29.4 [1 to 144] weeks). The effectiveness of anti-bullying programs did not diminish over time during follow-up (mean [range] follow-up, 30.9 [2-104] weeks).
Conclusions and Relevance: Despite the small ESs and some regional differences in effectiveness, the population impact of school anti-bullying interventions appeared to be substantial. Better designed trials that assess optimal intervention timing and duration are warranted.

References

  1. Lancet Psychiatry. 2018 Jul;5(7):591-604 [PMID: 29773478]
  2. Educ Psychol (Lond). 2013 Dec;33(7):862-883 [PMID: 26494932]
  3. BMJ. 2015 Jan 02;350:g7647 [PMID: 25555855]
  4. Psychol Med. 2016 Jul;46(9):1875-83 [PMID: 26979565]
  5. BMJ. 2000 Feb 19;320(7233):503-6 [PMID: 10678870]
  6. J Interpers Violence. 2003 Nov;18(11):1347-60 [PMID: 19774770]
  7. Int J Environ Res Public Health. 2018 Nov 13;15(11): [PMID: 30428513]
  8. Psychol Sci. 2013 Oct;24(10):1958-70 [PMID: 23959952]
  9. J Abnorm Child Psychol. 2012 Apr;40(3):403-12 [PMID: 21912844]
  10. Prev Sci. 2016 Nov;17(8):1012-1023 [PMID: 27488457]
  11. J Adolesc. 2018 Feb;63:107-117 [PMID: 29288995]
  12. Nat Hum Behav. 2017 Nov;1(11):775-777 [PMID: 31024118]
  13. Pediatrics. 2017 May;139(5): [PMID: 28557736]
  14. Schizophr Bull. 2012 Jun;38(4):661-71 [PMID: 22461484]
  15. JAMA Psychiatry. 2015 Sep;72(9):892-9 [PMID: 26176785]
  16. Pediatrics. 2017 Oct;140(4): [PMID: 28947607]
  17. BMJ. 2000 Oct 14;321(7266):950-3 [PMID: 11030691]
  18. Am Psychol. 2017 Feb-Mar;72(2):79-117 [PMID: 28221063]
  19. Int J Public Health. 2009;54(1):45-8 [PMID: 19142579]
  20. Lancet Psychiatry. 2015 Oct;2(10):930-41 [PMID: 26462227]
  21. Paediatr Child Health. 2018 Jul;23(4):262-265 [PMID: 30657133]
  22. J Consult Clin Psychol. 2010 Apr;78(2):156-68 [PMID: 20350027]
  23. Psychol Med. 2015 Oct;45(13):2705-15 [PMID: 25988703]
  24. Behav Ther. 2019 Jan;50(1):225-240 [PMID: 30661562]
  25. Am J Psychiatry. 2014 Jul;171(7):777-84 [PMID: 24743774]
  26. Psychol Health Med. 2017 Apr;22(4):381-392 [PMID: 26965476]
  27. Pediatrics. 2015 Feb;135(2):e496-509 [PMID: 25560447]
  28. J Clin Epidemiol. 2011 Dec;64(12):1294-302 [PMID: 21803546]
  29. Prev Sci. 2018 Aug;19(6):822-832 [PMID: 29707731]
  30. JAMA Psychiatry. 2017 Nov 1;74(11):1112-1119 [PMID: 28979965]
  31. J Am Acad Child Adolesc Psychiatry. 2019 Sep;58(9):907-918.e4 [PMID: 30926574]
  32. Dev Psychol. 2005 May;41(3):479-90 [PMID: 15910156]
  33. J Adolesc Health. 2013 Aug;53(2):180-6 [PMID: 23643338]
  34. Child Dev. 2011 Jan-Feb;82(1):311-30 [PMID: 21291444]
  35. Bull World Health Organ. 2010 Jun;88(6):403 [PMID: 20539848]
  36. Int J Epidemiol. 2018 Oct 1;47(5):1402-1413 [PMID: 30085115]
  37. PLoS One. 2011 Apr 27;6(4):e19070 [PMID: 21556361]
  38. Soc Sci Med. 2018 Jul;208:134-141 [PMID: 29803971]
  39. J Child Psychol Psychiatry. 2009 May;50(5):607-16 [PMID: 19207633]
  40. J Adolesc Health. 2013 Jul;53(1 Suppl):S13-20 [PMID: 23790195]
  41. J Clin Child Adolesc Psychol. 2004 Mar;33(1):196-201 [PMID: 15028553]
  42. J Child Health Care. 2015 Jun;19(2):136-53 [PMID: 24092871]
  43. Child Adolesc Psychiatr Clin N Am. 2016 Apr;25(2):235-42 [PMID: 26980126]
  44. Healthc Q. 2011;14 Spec No 2:80-91 [PMID: 24956430]
  45. Lancet. 2018 Dec 8;392(10163):2452-2464 [PMID: 30473366]
  46. Int J Environ Res Public Health. 2018 Dec 29;16(1): [PMID: 30597946]
  47. Aggress Behav. 2016 Mar-Apr;42(2):166-80 [PMID: 26351263]
  48. J Adolesc. 2009 Dec;32(6):1377-89 [PMID: 19647311]
  49. Pediatrics. 2019 Aug;144(2): [PMID: 31262779]
  50. Pediatrics. 2006 Oct;118(4):e1212-9 [PMID: 17015509]
  51. BMJ. 1997 Sep 13;315(7109):629-34 [PMID: 9310563]
  52. Aust N Z J Psychiatry. 2019 Sep;53(9):878-888 [PMID: 31067987]
  53. Arch Pediatr Adolesc Med. 2006 Jun;160(6):638-44 [PMID: 16754827]
  54. JAMA Pediatr. 2015 Aug;169(8):770-7 [PMID: 26098362]
  55. Eur J Public Health. 2015 Apr;25 Suppl 2:61-4 [PMID: 25805790]
  56. Child Dev. 2013 May-Jun;84(3):970-88 [PMID: 23106262]
  57. Crim Behav Ment Health. 2011 Apr;21(2):80-9 [PMID: 21370293]
  58. Front Psychiatry. 2019 Feb 07;10:40 [PMID: 30792670]
  59. J Adolesc Health. 2015 May;56(5):483-8 [PMID: 25631040]
  60. J Epidemiol Community Health. 2002 Aug;56(8):606-10 [PMID: 12118052]
  61. J Couns Psychol. 2015 Oct;62(4):732-40 [PMID: 26376177]
  62. Can J Psychiatry. 2017 Jun;62(6):368-373 [PMID: 28562091]
  63. BMJ. 2011 Oct 18;343:d5928 [PMID: 22008217]
  64. Am J Community Psychol. 2013 Sep;52(1-2):56-72 [PMID: 23625456]
  65. Glob Health Action. 2019;12(1):1656905 [PMID: 31512573]
  66. Violence Vict. 2017 Aug 1;32(4):609-626 [PMID: 28516835]
  67. J Adolesc. 2017 Dec;61:113-116 [PMID: 29035810]
  68. Int J Clin Health Psychol. 2019 Sep;19(3):237-242 [PMID: 31516502]
  69. Aggress Behav. 2009 Jul-Aug;35(4):342-56 [PMID: 19466744]
  70. Annu Rev Public Health. 2019 Apr 1;40:373-389 [PMID: 30601725]
  71. Pediatrics. 2013 Oct;132(4):720-9 [PMID: 24043275]
  72. Lancet Psychiatry. 2015 Jun;2(6):524-31 [PMID: 26360448]
  73. Trials. 2018 Nov 29;19(1):664 [PMID: 30497490]
  74. J Pediatr Psychol. 2017 Apr 01;42(3):245-259 [PMID: 27784727]
  75. Child Adolesc Ment Health. 2007 Feb;12(1):21-26 [PMID: 32811040]

MeSH Term

Bullying
Child
Humans
Randomized Controlled Trials as Topic
Schools

Word Cloud

Created with Highcharts 10.0.0interventionsinterventioneffectivenessanti-bullyingpopulationbullyingimpact-095%ESgroupoutcomesschoolsearchmeanCImentalhealthstudiestrialsRCTsarticlesincludedstudy1participantscontrolriskpreviousprogramsassociationassessmoderatorvariablesData3publisheddatabaseassessed4reportedidentified77ESs69usedestimatesnumberPINtotaluniversalmeasured8attitudesproblemsweightedrange4-17years0%-100%[range]durationweeksfollow-upImportance:BullyingprevalentmodifiablefactordisordersAlthoughsupportedspecificmoderatorsstillunclearObjective:Sources:OvidMEDLINEERICPsycInfodatabasesconductedusingsetstermsidentifyrandomizedclinicalassessinginceptionFebruary2020manualreferencelistssystematicreviewsmeta-analysesalsoperformedStudySelection:initialliteratureyielded34798Included2programRCTdesignresults5English16707371metcriteriareviewfull-textdataallowingcalculationeffectsizesindependentfinalmeta-analysisExtractionSynthesis:Random-effectsmeta-regressionmodelsderiveCohendvaluespooledCIstestassociationsPopulationdefinedchildreneventmaypreventedestimatetargetingstudentsregardlessindividualMainOutcomesMeasures:mainfollowingvariablecategories:overallperpetrationexposurecyberbullyingdiscourageencourageeganxietydepressionclimatewellassessmentpotentialassocationstrialcharacteristicsResults:samples111 659[56 51155 148group]age1110proportionfemale499%505%Anti-bullyingefficaciousreducing150191109improving205277133endpointPINstargetstudent147113-21310773-173respectivelyDurationstatisticallysignificantlyassociated29[1144]diminishtime309[2-104]ConclusionsRelevance:DespitesmallregionaldifferencesappearedsubstantialBetterdesignedoptimaltimingwarrantedAssessmentSchoolAnti-BullyingInterventions:Meta-analysisRandomizedClinicalTrials

Similar Articles

Cited By (35)