Using pay for performance to improve treatment implementation for adolescent substance use disorders: results from a cluster randomized trial.

Bryan R Garner, Susan H Godley, Michael L Dennis, Brooke D Hunter, Christin M L Bair, Mark D Godley
Author Information
  1. Bryan R Garner: Lighthouse Institute, Chestnut Health Systems, Normal, IL 61761, USA. brgarner@chestnut.org

Abstract

OBJECTIVE: To test whether pay for performance (P4P) is an effective method to improve adolescent substance use disorder treatment implementation and efficacy.
DESIGN: Cluster randomized trial.
SETTING: Community-based treatment organizations.
PARTICIPANTS: Twenty-nine community-based treatment organizations, 105 therapists, and 986 adolescent patients (953 with complete data).
INTERVENTION: Community-based treatment organizations were assigned to 1 of the following conditions: the implementation-as-usual (IAU) control condition or the P4P experimental condition. In addition to delivering the same evidence-based treatment (ie, using the Adolescent Community Reinforcement Approach [A-CRA]), each organization received standardized levels of funding, training, and coaching from the treatment developers. Therapists in the P4P condition received US $50 for each month that they demonstrated competence in treatment delivery (ie, A-CRA competence) and US $200 for each patient who received a specified number of treatment procedures and sessions (ie, target A-CRA) that has been found to be associated with significantly improved patient outcomes.
MAIN OUTCOME MEASURES: Outcomes included ACRA competence (ie, a therapist-level implementation measure), target A-CRA (ie, a patient-level implementation measure), and remission status (ie, a patient-level treatment effectiveness measure).
RESULTS: Relative to therapists in the IAU control condition, therapists in the P4P condition were significantly more likely to demonstrate A-CRA competence (24.0% vs 8.9%; event rate ratio, 2.24; 95% CI, 1.12- 4.48; P=.02). Relative to patients in the IAU control condition, patients in the P4P condition were significantly more likely to receive target A-CRA (17.3% vs 2.5%; odds ratio, 5.19; 95% CI, 1.53-17.62; P=.01). However, no significant differences were found between conditions with regard to patients' end-of-treatment remission status.
CONCLUSION: Pay for performance can be an effective method of improving treatment implementation.
TRIAL REGISTRATION: clinicaltrials.gov Identifier: NCT01016704

Associated Data

ClinicalTrials.gov | NCT01016704

References

  1. J Subst Abuse Treat. 2009 Jun;36(4):376-99 [PMID: 19008068]
  2. Health Policy. 2008 Sep;87(3):296-308 [PMID: 18325621]
  3. J Subst Abuse Treat. 2011 Jul;41(1):97-103 [PMID: 21315539]
  4. N Engl J Med. 2007 Jul 12;357(2):181-90 [PMID: 17625132]
  5. N Engl J Med. 2009 Jul 23;361(4):368-78 [PMID: 19625717]
  6. Eur J Health Econ. 2012 Dec;13(6):755-67 [PMID: 21660562]
  7. Eval Health Prof. 2006 Sep;29(3):302-33 [PMID: 16868340]
  8. J Subst Abuse Treat. 2009 Apr;36(3):252-64 [PMID: 18715742]
  9. Cochrane Database Syst Rev. 2011 Sep 07;(9):CD008451 [PMID: 21901722]
  10. Am J Med Qual. 2009 Mar-Apr;24(2):140-63 [PMID: 18984907]
  11. J Subst Abuse Treat. 2004 Oct;27(3):197-213 [PMID: 15501373]
  12. Psychol Assess. 2006 Jun;18(2):192-203 [PMID: 16768595]
  13. Med Care Res Rev. 2006 Feb;63(1 Suppl):49S-72S [PMID: 16688924]
  14. N Engl J Med. 2007 Feb 1;356(5):486-96 [PMID: 17259444]
  15. JAMA. 2005 Oct 12;294(14):1821-3 [PMID: 16219887]
  16. Drug Alcohol Depend. 2010 Jul 1;110(1-2):44-54 [PMID: 20219293]
  17. Addiction. 2007 Jan;102(1):81-93 [PMID: 17207126]
  18. JAMA. 2005 Oct 12;294(14):1788-93 [PMID: 16219882]
  19. Ann Intern Med. 2006 Aug 15;145(4):265-72 [PMID: 16908917]
  20. N Engl J Med. 2006 Jul 27;355(4):375-84 [PMID: 16870916]
  21. JAMA. 2007 Jun 6;297(21):2373-80 [PMID: 17551130]
  22. JAMA. 2007 Feb 21;297(7):740-4 [PMID: 17312294]
  23. Implement Sci. 2010 Jan 26;5:5 [PMID: 20205824]
  24. PLoS Med. 2009 May 26;6(5):e1000065 [PMID: 19536323]
  25. Adm Policy Ment Health. 2006 Nov;33(6):629-35 [PMID: 16758330]
  26. Med Care Res Rev. 2006 Apr;63(2):135-57 [PMID: 16595409]
  27. N Engl J Med. 2006 Nov 2;355(18):1895-902 [PMID: 17079763]
  28. Psychiatr Serv. 2008 Dec;59(12):1419-29 [PMID: 19033169]
  29. J Subst Abuse Treat. 2011 Sep;41(2):193-200 [PMID: 21489739]
  30. N Engl J Med. 2007 Feb 1;356(5):515-7 [PMID: 17259445]
  31. Clin Psychol (New York). 2011 Mar;18(1):67-83 [PMID: 21547241]
  32. Arch Intern Med. 2008 Oct 13;168(18):1993-9 [PMID: 18852400]
  33. J Clin Oncol. 2007 Aug 10;25(23):3482-7 [PMID: 17687153]

Grants

  1. TI17605/CSAT SAMHSA HHS
  2. TI17755/CSAT SAMHSA HHS
  3. TI17719/CSAT SAMHSA HHS
  4. R01 AA017625/NIAAA NIH HHS
  5. TI19313/CSAT SAMHSA HHS
  6. TI17812/CSAT SAMHSA HHS
  7. TI17765/CSAT SAMHSA HHS
  8. TI17604/CSAT SAMHSA HHS
  9. TI17742/CSAT SAMHSA HHS
  10. TI17589/CSAT SAMHSA HHS
  11. TI17673/CSAT SAMHSA HHS
  12. TI17779/CSAT SAMHSA HHS
  13. TI17702/CSAT SAMHSA HHS
  14. TI17769/CSAT SAMHSA HHS
  15. R01-AA017625/NIAAA NIH HHS
  16. TI17638/CSAT SAMHSA HHS
  17. TI17646/CSAT SAMHSA HHS
  18. TI17728/CSAT SAMHSA HHS
  19. TI17847/CSAT SAMHSA HHS
  20. TI17744/CSAT SAMHSA HHS
  21. TI17751/CSAT SAMHSA HHS
  22. TI17830/CSAT SAMHSA HHS
  23. TI17786/CSAT SAMHSA HHS
  24. TI19323/CSAT SAMHSA HHS
  25. 270-07-0191/PHS HHS
  26. TI17788/CSAT SAMHSA HHS
  27. TI17817/CSAT SAMHSA HHS
  28. TI17775/CSAT SAMHSA HHS
  29. TI17864/CSAT SAMHSA HHS
  30. TI17761/CSAT SAMHSA HHS
  31. TI17763/CSAT SAMHSA HHS
  32. TI17724/CSAT SAMHSA HHS

MeSH Term

Adolescent
Adult
Clinical Competence
Community Mental Health Services
Female
Humans
Intention to Treat Analysis
Logistic Models
Male
Middle Aged
Propensity Score
Reimbursement, Incentive
Substance-Related Disorders
Treatment Outcome

Word Cloud

Created with Highcharts 10.0.0treatmentconditionieP4PimplementationA-CRAcompetenceperformanceadolescentorganizationstherapistspatients1IAUcontrolreceivedtargetsignificantlymeasurepayeffectivemethodimprovesubstanceuserandomizedtrialCommunity-basedUSpatientfoundpatient-levelremissionstatusRelativelikely24vsratio295%CIP=OBJECTIVE:testwhetherdisorderefficacyDESIGN:ClusterSETTING:PARTICIPANTS:Twenty-ninecommunity-based105986953completedataINTERVENTION:assignedfollowingconditions:implementation-as-usualexperimentaladditiondeliveringevidence-basedusingAdolescentCommunityReinforcementApproach[A-CRA]organizationstandardizedlevelsfundingtrainingcoachingdevelopersTherapists$50monthdemonstrateddelivery$200specifiednumberproceduressessionsassociatedimprovedoutcomesMAINOUTCOMEMEASURES:OutcomesincludedACRAtherapist-leveleffectivenessRESULTS:demonstrate0%89%eventrate12-44802receive173%5%odds51953-176201Howeversignificantdifferencesconditionsregardpatients'end-of-treatmentCONCLUSION:PaycanimprovingTRIALREGISTRATION:clinicaltrialsgovIdentifier:NCT01016704Usingdisorders:resultscluster

Similar Articles

Cited By