Harnessing Available Evidence in Single-Case Experimental Studies: The Use of Multilevel Meta-Analysis.

Wim Van den Noortgate, Patrick Onghena
Author Information
  1. Wim Van den Noortgate: Methodology of Educational Sciences Research Group, Faculty of Psychology and Educational Sciences, KU Leuven, Belgium. ORCID
  2. Patrick Onghena: Methodology of Educational Sciences Research Group, Faculty of Psychology and Educational Sciences, KU Leuven, Belgium. ORCID

Abstract

The use of multilevel models to combine and compare the results of multiple single-case experimental design (SCED) studies has been proposed about two decades ago. Since then, the number of multilevel meta-analyses of SCED studies steadily increased, together with the complexity of multilevel models used. At the same time, many studies were done to empirically evaluate the approach in a variety of situations, and to study how the flexibility of multilevel models can be employed to account for many complexities that often are encountered in SCED research, such as autocorrelation, linear and nonlinear time trends, specific designs, external event effects, multiple outcomes, and heterogeneity. In this paper, we give a state-of-the-art of the multilevel approach, by making an overview of basic and more extended models, summarizing simulation results, and discussing some remaining issues.

Keywords

References

  1. Behav Modif. 2016 Nov;40(6):874-900 [PMID: 27126988]
  2. Behav Res Ther. 2019 Aug;119:103414 [PMID: 31203150]
  3. Behav Res Methods. 2024 Apr;56(4):2765-2781 [PMID: 38383801]
  4. Behav Modif. 2013 May;37(3):378-90 [PMID: 23408384]
  5. J Appl Behav Anal. 2016 Sep;49(3):656-73 [PMID: 27174301]
  6. Behav Res Methods. 2020 Feb;52(1):177-192 [PMID: 30972557]
  7. Behav Modif. 2020 Mar;44(2):265-295 [PMID: 30360633]
  8. Dev Neurorehabil. 2018 May;21(4):253-265 [PMID: 26864247]
  9. Res Synth Methods. 2012 Sep;3(3):224-39 [PMID: 26062165]
  10. Psychol Methods. 2014 Dec;19(4):493-510 [PMID: 24933294]
  11. Behav Res Methods. 2012 Dec;44(4):1244-54 [PMID: 22648696]
  12. Psychol Methods. 2017 Dec;22(4):760-778 [PMID: 28358542]
  13. Psychol Methods. 2012 Dec;17(4):510-50 [PMID: 22845874]
  14. Behav Res Methods. 2005 Feb;37(1):11-22 [PMID: 16097340]
  15. Multivariate Behav Res. 2013 Sep;48(5):719-48 [PMID: 26741060]
  16. Multivariate Behav Res. 2015;50(2):162-83 [PMID: 26609876]
  17. Behav Res Methods. 2013 Jun;45(2):576-94 [PMID: 23055166]
  18. Psychol Methods. 2024 Jun;29(3):537-560 [PMID: 35786985]
  19. Behav Res Methods. 2011 Dec;43(4):971-80 [PMID: 21656107]
  20. Behav Res Methods. 2017 Feb;49(1):363-381 [PMID: 26927003]
  21. PLoS Med. 2009 Jul 21;6(7):e1000097 [PMID: 19621072]
  22. Behav Modif. 2011 Jul;35(4):303-22 [PMID: 21411481]
  23. Behav Res Methods. 2019 Dec;51(6):2477-2497 [PMID: 30105444]
  24. Res Dev Disabil. 2018 Aug;79:97-115 [PMID: 29289406]
  25. Behav Res Methods. 2022 Aug;54(4):1559-1579 [PMID: 34508288]
  26. Psychol Methods. 2010 Jun;15(2):124-44 [PMID: 20515235]
  27. Behav Res Methods. 2013 Jun;45(2):547-59 [PMID: 23233188]
  28. J Appl Behav Anal. 2010 Mar;43(1):35-45 [PMID: 20808494]
  29. Res Synth Methods. 2013 Dec;4(4):324-41 [PMID: 26053946]
  30. J Sch Psychol. 2014 Apr;52(2):179-89 [PMID: 24606974]
  31. J Appl Behav Anal. 2020 Jul;53(3):1799-1821 [PMID: 32421220]
  32. Psychol Methods. 2013 Sep;18(3):385-405 [PMID: 23834421]
  33. Behav Res Methods. 2012 Sep;44(3):795-805 [PMID: 22180105]
  34. Behav Res Methods. 2015 Dec;47(4):1274-1294 [PMID: 25361866]
  35. Behav Res Methods. 2020 Oct;52(5):2008-2019 [PMID: 32144730]
  36. Res Dev Disabil. 2018 Aug;79:53-64 [PMID: 29958733]
  37. Behav Modif. 2014 Nov;38(6):878-913 [PMID: 25092718]
  38. Behav Modif. 2014 Sep;38(5):665-704 [PMID: 24902590]
  39. J Sch Psychol. 2014 Apr;52(2):123-47 [PMID: 24606972]
  40. Neuropsychol Rehabil. 2014;24(3-4):445-63 [PMID: 23883189]
  41. Multivariate Behav Res. 2022 Mar-May;57(2-3):298-317 [PMID: 32996335]
  42. Behav Res Methods. 2013 Mar;45(1):65-74 [PMID: 22806706]
  43. Behav Ther. 2009 Dec;40(4):357-67 [PMID: 19892081]
  44. Behav Modif. 2017 Mar;41(2):179-228 [PMID: 27553741]
  45. J Sch Psychol. 2014 Apr;52(2):191-211 [PMID: 24606975]
  46. Psychol Methods. 2023 Aug 21;: [PMID: 37603012]
  47. Behav Modif. 2023 Nov;47(6):1345-1376 [PMID: 31165621]
  48. Perspect Behav Sci. 2021 Mar 25;45(1):153-186 [PMID: 35342872]
  49. Res Synth Methods. 2010 Jan;1(1):39-65 [PMID: 26056092]
  50. Behav Res Methods. 2019 Jun;51(3):1286-1304 [PMID: 29873036]
  51. Multivariate Behav Res. 2019 Sep-Oct;54(5):666-689 [PMID: 30857444]
  52. J Sch Psychol. 2016 Jun;56:133-42 [PMID: 27268573]
  53. Behav Res Methods. 2016 Jun;48(2):803-12 [PMID: 26463724]
  54. Behav Res Methods Instrum Comput. 2003 Feb;35(1):1-10 [PMID: 12723775]
  55. Neuropsychol Rehabil. 2013;23(5):619-38 [PMID: 24050810]
  56. Perspect Behav Sci. 2021 Sep 1;45(1):13-35 [PMID: 35342874]
  57. Behav Res Methods. 2009 May;41(2):372-84 [PMID: 19363177]
  58. Behav Res Methods. 2010 Nov;42(4):930-43 [PMID: 21139160]
  59. Behav Res Methods. 2020 Apr;52(2):654-666 [PMID: 31270794]

Word Cloud

Created with Highcharts 10.0.0multilevelmodelsSCEDexperimentaldesignstudiesresultsmultiplesingle-casetimemanyapproachusecombinecompareproposedtwodecadesagoSincenumbermeta-analysessteadilyincreasedtogethercomplexityuseddoneempiricallyevaluatevarietysituationsstudyflexibilitycanemployedaccountcomplexitiesoftenencounteredresearchautocorrelationlinearnonlineartrendsspecificdesignsexternaleventeffectsoutcomesheterogeneitypapergivestate-of-the-artmakingoverviewbasicextendedsummarizingsimulationdiscussingremainingissuesHarnessingAvailableEvidenceSingle-CaseExperimentalStudies:UseMultilevelMeta-Analysismeta-analysissingle-subject

Similar Articles

Cited By