Consequences of misspecifying the number of latent treatment attendance classes in modeling group membership turnover within ecologically valid behavioral treatment trials.

Antonio A Morgan-Lopez, William Fals-Stewart
Author Information
  1. Antonio A Morgan-Lopez: RTI International, Behavioral Health and Criminal Justice Division, Research Triangle Park, NC 27709, USA. amorganlopez@rti.org

Abstract

Historically, difficulties in analyzing treatment outcome data from open-enrollment groups have led to their avoidance in use in federally funded treatment trials despite the fact that 79% of treatment programs use open-enrollment groups. Recently, latent class pattern mixture models (LCPMM) have shown promise as a defensible approach for making overall (and attendance-class-specific) inferences from open-enrollment groups with membership turnover. We present a statistical simulation study comparing LCPMMs to longitudinal growth models (LGM) to understand when both frameworks are likely to produce conflicting inferences concerning overall treatment efficacy. LCPMMs performed well under all conditions examined; meanwhile, LGMs produced problematic levels of bias and Type I errors under two joint conditions: moderate to high dropout (30%-50%) and treatment by attendance class interactions exceeding Cohen's d approximately .2. This study highlights key concerns about using LGM for open-enrollment data: treatment effect overestimation and advocacy for treatments that may be ineffective in reality.

References

  1. Stat Med. 2003 Aug 30;22(16):2553-75 [PMID: 12898544]
  2. Biometrics. 2003 Dec;59(4):829-36 [PMID: 14969461]
  3. Stat Med. 2005 Aug 15;24(15):2345-63 [PMID: 15977286]
  4. J Subst Abuse Treat. 2008 Jul;35(1):36-40 [PMID: 17936551]
  5. Addiction. 2000 Nov;95 Suppl 3:S381-94 [PMID: 11132364]
  6. Biometrics. 2004 Jun;60(2):295-305 [PMID: 15180654]
  7. J Nerv Ment Dis. 1993 Mar;181(3):189-93 [PMID: 8445378]
  8. Psychol Methods. 2001 Dec;6(4):330-51 [PMID: 11778676]
  9. J Consult Clin Psychol. 2005 Oct;73(5):924-35 [PMID: 16287392]
  10. Exp Clin Psychopharmacol. 2006 May;14(2):265-73 [PMID: 16756430]
  11. J Consult Clin Psychol. 2007 Aug;75(4):580-93 [PMID: 17663612]
  12. Behav Res Methods. 2006 Feb;38(1):77-87 [PMID: 16817516]
  13. Sci Pract Perspect. 2004 Aug;2(2):30-41 [PMID: 18552731]
  14. Psychol Methods. 2002 Mar;7(1):83-104 [PMID: 11928892]
  15. Multivariate Behav Res. 2004 Jan 1;39(1):99 [PMID: 20157642]
  16. Harv Rev Psychiatry. 2004 Nov-Dec;12(6):339-50 [PMID: 15764469]
  17. Psychol Methods. 2002 Jun;7(2):147-77 [PMID: 12090408]

Grants

  1. R01DA12189/NIDA NIH HHS
  2. R01 DA012189/NIDA NIH HHS
  3. R01DA016236/NIDA NIH HHS
  4. R01 DA015937/NIDA NIH HHS
  5. R21 DA021147/NIDA NIH HHS
  6. R01DA016236-SUPL/NIDA NIH HHS
  7. R21 AA013690/NIAAA NIH HHS
  8. R21DA021147/NIDA NIH HHS
  9. R01DA015937/NIDA NIH HHS
  10. R01 DA014402/NIDA NIH HHS
  11. R01 DA016236/NIDA NIH HHS
  12. R21AA016543/NIAAA NIH HHS
  13. R21 AA016543/NIAAA NIH HHS
  14. R01DA014402-SUPL/NIDA NIH HHS
  15. R01DA014402/NIDA NIH HHS

MeSH Term

Behavior Therapy
Bias
Clinical Trials as Topic
Computer Simulation
Epidemiologic Methods
Humans
Models, Statistical
Outcome Assessment, Health Care
Patient Acceptance of Health Care
Patient Dropouts
Psychotherapy, Group
Substance-Related Disorders

Word Cloud

Created with Highcharts 10.0.0treatmentopen-enrollmentgroupsusetrialslatentclassmodelsoverallinferencesmembershipturnoverstudyLCPMMsLGMattendanceHistoricallydifficultiesanalyzingoutcomedataledavoidancefederallyfundeddespitefact79%programsRecentlypatternmixtureLCPMMshownpromisedefensibleapproachmakingattendance-class-specificpresentstatisticalsimulationcomparinglongitudinalgrowthunderstandframeworkslikelyproduceconflictingconcerningefficacyperformedwellconditionsexaminedmeanwhileLGMsproducedproblematiclevelsbiasTypeerrorstwojointconditions:moderatehighdropout30%-50%interactionsexceedingCohen'sdapproximately2highlightskeyconcernsusingdata:effectoverestimationadvocacytreatmentsmayineffectiverealityConsequencesmisspecifyingnumberclassesmodelinggroupwithinecologicallyvalidbehavioral

Similar Articles

Cited By