A flexible approach to identify interaction effects between moderators in meta-analysis.

Xinru Li, Elise Dusseldorp, Jacqueline J Meulman
Author Information
  1. Xinru Li: Mathematical Institute, Leiden University, Leiden, The Netherlands. ORCID
  2. Elise Dusseldorp: Institute of Psychology, Leiden University, Leiden, The Netherlands.
  3. Jacqueline J Meulman: Mathematical Institute, Leiden University, Leiden, The Netherlands.

Abstract

In meta-analytic studies, there are often multiple moderators available (eg, study characteristics). In such cases, traditional meta-analysis methods often lack sufficient power to investigate interaction effects between moderators, especially high-order interactions. To overcome this problem, meta-CART was proposed: an approach that applies classification and regression trees (CART) to identify interactions, and then subgroup meta-analysis to test the significance of moderator effects. The aim of this study is to improve meta-CART upon two aspects: 1) to integrate the two steps of the approach into one and 2) to consistently take into account the fixed-effect or random-effects assumption in both the the interaction identification and testing process. For fixed effect meta-CART, weights are applied, and subgroup analysis is adapted. For random effects meta-CART, a new algorithm has been developed. The performance of the improved meta-CART was investigated via an extensive simulation study on different types of moderator variables (ie, dichotomous, nominal, ordinal, and continuous variables). The simulation results revealed that the new method can achieve satisfactory performance (power greater than 0.80 and Type I error less than 0.05) if appropriate pruning rule is applied and the number of studies is large enough. The required minimum number of studies ranges from 40 to 120 depending on the complexity and strength of the interaction effects, the within-study sample size, the type of moderators, and the residual heterogeneity.

Keywords

References

  1. Br J Math Stat Psychol. 2011 Feb;64(Pt 1):161-81 [PMID: 21506949]
  2. Psychol Methods. 2005 Mar;10(1):40-64 [PMID: 15810868]
  3. Br J Math Stat Psychol. 2017 Feb;70(1):118-136 [PMID: 28130936]
  4. Res Synth Methods. 2010 Apr;1(2):97-111 [PMID: 26061376]
  5. Diabetes Educ. 2009 Sep-Oct;35(5):818-35 [PMID: 19687258]
  6. Stat Med. 2018 Jul 30;37(17):2547-2560 [PMID: 29707855]
  7. Am J Epidemiol. 2009 May 1;169(9):1158-65 [PMID: 19258485]
  8. Psychol Methods. 2003 Dec;8(4):434-47 [PMID: 14664681]
  9. Health Psychol. 2009 Nov;28(6):690-701 [PMID: 19916637]
  10. Stat Med. 2004 Jun 15;23(11):1663-82 [PMID: 15160401]
  11. Health Psychol. 2014 Dec;33(12):1530-40 [PMID: 24274802]
  12. Control Clin Trials. 1986 Sep;7(3):177-88 [PMID: 3802833]
  13. Psychiatry Res. 2009 Nov 30;174(2):81-8 [PMID: 19833485]
  14. Res Synth Methods. 2019 Mar;10(1):134-152 [PMID: 30511514]
  15. Health Psychol Rev. 2015;9(4):417-33 [PMID: 25689096]
  16. Br J Math Stat Psychol. 2007 May;60(Pt 1):29-60 [PMID: 17535578]
  17. Br J Math Stat Psychol. 2009 Feb;62(Pt 1):97-128 [PMID: 18001516]
  18. Res Synth Methods. 2016 Dec;7(4):387-401 [PMID: 27936303]
  19. Health Psychol Rev. 2015;9(1):25-9 [PMID: 25793487]
  20. Res Synth Methods. 2016 Jun;7(2):121-39 [PMID: 27286899]

MeSH Term

Algorithms
Computer Simulation
Data Interpretation, Statistical
Effect Modifier, Epidemiologic
Humans
Meta-Analysis as Topic
Models, Statistical
Monte Carlo Method
Regression Analysis
Research Design
Sample Size

Word Cloud

Created with Highcharts 10.0.0effectsmoderatorsinteractionmeta-CARTmeta-analysisstudiesstudyapproachoftenpowerinteractionsCARTidentifysubgroupmoderatortwofixedeffectappliedrandomnewperformancesimulationvariables0numbermeta-analyticmultipleavailableegcharacteristicscasestraditionalmethodslacksufficientinvestigateespeciallyhigh-orderovercomeproblemproposed:appliesclassificationregressiontreestestsignificanceaimimproveuponaspects:1integratestepsone2consistentlytakeaccountfixed-effectrandom-effectsassumptionidentificationtestingprocessweightsanalysisadaptedalgorithmdevelopedimprovedinvestigatedviaextensivedifferenttypesiedichotomousnominalordinalcontinuousresultsrevealedmethodcanachievesatisfactorygreater80Typeerrorless05appropriatepruningrulelargeenoughrequiredminimumranges40120dependingcomplexitystrengthwithin-studysamplesizetyperesidualheterogeneityflexible

Similar Articles

Cited By (7)