Practice Makes Proficient: Evaluation of Implementation Fidelity Following COMPASS Consultation Training.

Lisa Ruble, Lindsey Ogle, John McGrew
Author Information
  1. Lisa Ruble: Department of Special Education, Ball State University.
  2. Lindsey Ogle: Department of Special Education, Ball State University.
  3. John McGrew: Department of Psychology, Indiana University-Purdue University.

Abstract

Objective: To test a training package for COMPASS, a multi-level consultation and coaching intervention for improved educational outcomes of students with ASD.
Method: Using a Hybrid Type 3 design with emphasis on implementation and a multidimensional approach to evaluating implementation outcomes, we tested a training package with community-based consultant trainees (CTs) unfamiliar with COMPASS and evaluated acceptance, appropriateness, feasibility, and fidelity from multiple sources (trainees, teachers, and parents).
Results: Results confirm that COMPASS-naïve CTs can be successfully trained. At least one feedback session was needed to achieve proficiency. Initial fidelity ratings between researchers and CTs were disparate suggesting self-report may not be adequate. Four feedback opportunities were required to achieve proficiency in writing intervention plans, an activity particularly challenging for CTs. Teachers and parents perceived COMPASS as acceptable, appropriate, and feasible. CTs knowledge of EBPs increased significantly following training; however, positive attitudes toward EBPs did not.
Conclusions: The implementation outcomes suggest that the training package was effective for training CTs; however, additional practice with writing intervention plans is warranted.

Keywords

References

  1. J Autism Dev Disord. 2012 Sep;42(9):1974-83 [PMID: 22271197]
  2. Implement Sci. 2015 Nov 04;10:155 [PMID: 26537706]
  3. Eur J Behav Anal. 2020;21(1):55-73 [PMID: 32982588]
  4. Clin Psychol (New York). 2018 Sep;25(3): [PMID: 30713369]
  5. J Autism Dev Disord. 2017 Nov;47(11):3550-3561 [PMID: 28856480]
  6. Autism Res. 2016 Aug;9(8):838-45 [PMID: 26608837]
  7. Implement Sci. 2007 Nov 30;2:40 [PMID: 18053122]
  8. Med Care. 2012 Mar;50(3):217-26 [PMID: 22310560]
  9. Clin Psychol Rev. 1998 Jan;18(1):23-45 [PMID: 9455622]
  10. Implement Sci. 2018 Jan 08;13(1):3 [PMID: 29310683]
  11. Res Autism Spectr Disord. 2020 Mar;71: [PMID: 32863861]
  12. J Autism Dev Disord. 2018 Oct;48(10):3586-3595 [PMID: 29858713]
  13. MMWR Surveill Summ. 2021 Dec 03;70(11):1-16 [PMID: 34855725]
  14. Focus Autism Other Dev Disabl. 2005;20(2):66-79 [PMID: 16467905]
  15. Ment Health Serv Res. 2004 Jun;6(2):61-74 [PMID: 15224451]
  16. J Autism Dev Disord. 2020 Jun;50(6):1931-1940 [PMID: 30820727]
  17. Sch Psychol Q. 2018 Jun;33(2):251-263 [PMID: 28857590]
  18. Health Educ Res. 2003 Apr;18(2):237-56 [PMID: 12729182]
  19. J Early Interv. 2010 Sep;32(4):286-301 [PMID: 21691449]
  20. Pediatr Med. 2019 May;2: [PMID: 31565699]
  21. Adm Policy Ment Health. 2021 Mar;48(2):266-278 [PMID: 32653973]
  22. J Autism Dev Disord. 2013 Dec;43(12):2970-6 [PMID: 23619949]
  23. J Consult Clin Psychol. 2013 Jun;81(3):566-72 [PMID: 23438314]
  24. J Child Fam Stud. 2021 Feb;30(2):542-555 [PMID: 34149272]
  25. J Appl Behav Anal. 1991 Summer;24(2):189-204 [PMID: 1890040]
  26. J Autism Dev Disord. 2019 Nov;49(11):4585-4594 [PMID: 31432310]
  27. Psychiatr Serv. 2012 Jul;63(7):660-5 [PMID: 22549401]
  28. Early Child Res Q. 2010 Jul 1;25(3):299-313 [PMID: 20824112]
  29. J Appl Behav Anal. 2007 Fall;40(3):447-61 [PMID: 17970259]
  30. Adm Policy Ment Health. 2011 Mar;38(2):65-76 [PMID: 20957426]

Grants

  1. R34 MH073071/NIMH NIH HHS
  2. R34 MH111783/NIMH NIH HHS

Word Cloud

Created with Highcharts 10.0.0CTstrainingCOMPASSpackageinterventionoutcomesimplementationtraineesfidelityparentsfeedbackachieveproficiencywritingplansEBPshoweverFidelityConsultationTrainingObjective:testmulti-levelconsultationcoachingimprovededucationalstudentsASDMethod:UsingHybridType3designemphasismultidimensionalapproachevaluatingtestedcommunity-basedconsultantunfamiliarevaluatedacceptanceappropriatenessfeasibilitymultiplesourcesteachersResults:ResultsconfirmCOMPASS-naïvecansuccessfullytrainedleastonesessionneededInitialratingsresearchersdisparatesuggestingself-reportmayadequateFouropportunitiesrequiredactivityparticularlychallengingTeachersperceivedacceptableappropriatefeasibleknowledgeincreasedsignificantlyfollowingpositiveattitudestowardnotConclusions:suggesteffectiveadditionalpracticewarrantedPracticeMakesProficient:EvaluationImplementationFollowingAutism

Similar Articles

Cited By