Abstract
Community implementation of evidence-based practices (EBPs) for Attention Deficit/Hyperactivity Disorder (ADHD) is greatly lacking. A recent randomized community-based trial of an EBP for ADHD (Supporting Teens’ Autonomy Daily; STAND) demonstrated suboptimal implementation and effectiveness outcomes. In the present study, we conducted an Innovation Tournament (IT) with agency staff stakeholders (N = 26) to identify barriers to successful implementation of STAND and implementation strategies for a revised service delivery model. We conducted member-checking of agency staff-generated ideas with parents (N = 226) and subsequent querying of additional parent (N = 226) and youth-generated (N = 205) strategies to improve care. Go-Zone plots were utilized to identify strategies with the highest feasibility and importance. Practical barriers (i.e., transportation, scheduling difficulties) and parent/youth engagement were the most commonly cited obstacles to successful implementation of STAND in community contexts. Eighteen “winning” implementation strategies were identified that survived member checking. These were classified as train and educate stakeholders (n = 5; e.g., train agency supervisors to deliver supervision, digitize treatment materials and trainings), engage consumers (n = 9; e.g., begin treatment with rapport building sessions, increase psychoeducation), provide interactive assistance (n = 2; e.g., add group supervision, increase roleplay in supervision), and use of evaluative/iterative strategies (n = 2; e.g., perform fidelity checks, supervisor review of session recordings). Parents and youth desired longer duration of treatment and increased focus on maintenance. Strategies will be developed and tested as part of a pilot effectiveness trial designed to refine STAND’s service delivery model.
Trial Registration NCT02694939 www.clinicaltrials.gov
Similar content being viewed by others
References
Atkins, D. C., Steyvers, M., Imel, Z. E., & Smyth, P. (2014). Scaling up the evaluation of psychotherapy: Evaluating motivational interviewing fidelity via statistical text classification. Implementation Science, 9(1), 49. https://doi.org/10.1186/1748-5908-9-49
Bartholomew, L. K., Parcel, G. S., Kok, G., Gottlieb, N. H., Schaalma, H. C., Markham, C. C., & Gonzales, A. C. (2006). Planning health promotion programs: An intervention map** approach. Jossey-Bass.
Brinkman, W. B., Simon, J. O., & Epstein, J. N. (2018). Reasons why children and adolescents with attention-deficit/hyperactivity disorder stop and restart taking medicine. Academic Pediatrics, 18(3), 273–280. https://doi.org/10.1016/j.acap.2017.09.005
Bussing, R., Zima, B. T., Mason, D. M., Porter, P. C., & Garvan, C. W. (2011). Receiving treatment for attention-deficit hyperactivity disorder: Do the perspectives of adolescents matter? Journal of Adolescent Health, 49(1), 7–14. https://doi.org/10.1016/j/jadohealth.2010.08.014
Bussing, R., Koro-Ljungberg, M., Noguchi, K., Mason, D., Mayerson, G., & Garvan, C. W. (2012). Willingness to use ADHD treatments: A mixed methods study of perceptions by adolescents, parents, health professionals and teachers. Social Science & Medicine, 74, 92–100. https://doi.org/10.1016/j.socscimed.2011.10.009
Chorpita, B. F., Daleiden, E. L., Park, A. L., Ward, A. M., Levy, M. C., Cromley, T., & Krull, J. L. (2017). Child STEPs in California: A cluster randomized effectiveness trial comparing modular treatment with community implemented treatment for youth with anxiety, depression, conduct problems, or traumatic stress. Journal of Consulting and Clinical Psychology, 85(1), 13–25. https://doi.org/10.1037/ccp0000133
Conners, C. K., Epstein, J. N., March, J. S., Angold, A., Wells, K. C., Klaric, J., & Greenhill, L. (2001). Multimodal treatment of ADHD in the MTA: An alternative outcome analysis. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 159–167. https://doi.org/10.1097/00004583-200102000-00010
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 1–15. https://doi.org/10.1186/1748-5908-4-50
Danielson, M. L., Bitsko, R. H., Ghandour, R. M., Holbrook, J. R., Kogan, M. D., & Blumberg, S. J. (2018). Prevalence of parent-reported ADHD diagnosis and associated treatment among US children and adolescents, 2016. Journal of Clinical Child & Adolescent Psychology, 47(2), 199–212. https://doi.org/10.1080/15374416.2017.1417860
Epstein, J. N., Kelleher, K. J., Baum, R., Brinkman, W. B., Peugh, J., Gardner, W., & Langberg, J. (2014). Variability in ADHD care in community-based pediatrics. Pediatrics, 134(6), 1136–1143. https://doi.org/10.1542/peds.2014-1500
Evans, S. W., Owens, J. S., Wymbs, B. T., & Ray, A. R. (2018). Evidence-based psychosocial treatments for children and adolescents with attention deficit/hyperactivity disorder. Journal of Clinical Child & Adolescent Psychology, 47(2), 157–198. https://doi.org/10.1080/15374416.2017.1390757
Flottorp, S. A., Oxman, A. D., Krause, J., Musila, N. R., Wensing, M., Godycki-Cwirko, M., & Eccles, M. P. (2013). A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implementation Science, 8(1), 1–11. https://doi.org/10.1186/1748-5908-8-35
Frey, A. J., Lee, J., Small, J. W., Walker, H. M., & Seeley, J. R. (2017). Motivational interviewing training and assessment system (MITAS) for school-based applications. Report on Emotional & Behavioral Disorders in Youth, 17(4), 86–92
Garland, A. F., Bickman, L., & Chorpita, B. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 15–26. https://doi.org/10.1007/s10488-010-0279-y
Goodman, M. S., & Sanders Thompson, V. L. (2017). The science of stakeholder engagement in research: Classification, implementation, and evaluation. Translational Behavioral Medicine, 7(3), 486–491. https://doi.org/10.1007/s13142-017-0495-z
Hoagwood, K. E., Olin, S. S., Horwitz, S., McKay, M., Cleek, A., Gleacher, A., & Kup**er, A. (2014). Scaling up evidence-based practices for children and families in New York State: Toward evidence-based policies on implementation for state mental health systems. Journal of Clinical Child & Adolescent Psychology, 43(2), 145–157. https://doi.org/10.1080/15374416.2013.869749
Imel, Z. E., Pace, B. T., Soma, C. S., Tanana, M., Hirsch, T., Gibson, J., & Atkins, D. C. (2019). Design feasibility of an automated, machine-learning based feedback system for motivational interviewing. Psychotherapy, 56(2), 318. https://doi.org/10.1037/pst0000221
Jensen, P. S., Garcia, J. A., Glied, S., Crowe, M., Foster, M., Schlander, M., & Hechtman, L. (2005). Cost-effectiveness of ADHD treatments: Findings from the multimodal treatment study of children with ADHD. American Journal of Psychiatry, 162(9), 1628–1636. https://doi.org/10.1176/appi.ajp.162.9.1628
Jensen, P. S., Arnold, L. E., Swanson, J. M., Vitiello, B., Abikoff, H. B., Greenhill, L. L., & Conners, C. K. (2007). 3-year follow-up of the NIMH MTA study. Journal of the American Academy of Child & Adolescent Psychiatry, 46(8), 989–1002. https://doi.org/10.1097/CHI.0b013e3180686d48
Kok, G., Gottlieb, N. H., Peters, G. J. Y., Mullen, P. D., Parcel, G. S., Ruiter, R. A., & Bartholomew, L. K. (2016). A taxonomy of behaviour change methods: An intervention map** approach. Health Psychology Review, 10(3), 297–312. https://doi.org/10.1080/17437199.2015.1077155
Merriam, S. B. (1998). Qualitative research and case study applications in education. Jossey-Bass.
Miller, W. R., & Rollnick, S. (2013). Motivational interviewing: Hel** people change (applications of motivational interviewing). Guilford Press.
Miller, D. T., & Ross, M. (1975). Self-serving biases in the attribution of causality: Fact or fiction? Psychological Bulletin, 82(2), 213. https://doi.org/10.1037/h0076486
MTA Cooperative Group. (1999). Multimodal Treatment Study of Children with ADHD A 14-month randomized clinical trial of treatment strategies for attention-deficit/hyperactivity disorder. Archives of General Psychiatry, 56(12), 1073–1086. https://doi.org/10.1001/archpsyc.56.12.1073
Nakamura, B. J., Higa-McMillan, C. K., Okamura, K. H., & Shimabukuro, S. (2011). Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Administration and Policy in Mental Health and Mental Health Services Research, 38(4), 287–300. https://doi.org/10.1007/s10488-011-0351-2
Nilsen, P. (2015). Making sense of implementation theories, models and frameworks. Implementation Science, 10(1), 53. https://doi.org/10.1186/s13012-015-0242-0
Polanczyk, G. V., Salum, G. A., Sugaya, L. S., Caye, A., & Rohde, L. A. (2015). Annual research review: A meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. Journal of Child Psychology and Psychiatry, 56(3), 345–365. https://doi.org/10.1111/jcpp.12381
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., & Kirchner, J. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10(1), 21. https://doi.org/10.1186/s13012-015-0209-1
Powell, B. J., Beidas, R., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2017). Methods to improve the selection and tailoring of implementation strategies. The Journal of Behavioral Health Services & Research, 44, 177–194. https://doi.org/10.1007/s11414-015-9475-6
Schoenwald, S. K., Chapman, J., Kelleher, K., Hoagwood, K. E., Landsverk, J., Stevens, J., et al. (2008). A survey of the infrastructure for children’s mental health services: Implications for the implementation of empirically supported treatments (ESTs). Administration and Policy in Mental Health and Mental Health Services Research, 35, 84–97. https://doi.org/10.1007/s10488-007-0147-6
Sibley, M. H., Kuriyan, A. B., Evans, S. W., Waxmonsky, J. G., & Smith, B. H. (2014). Pharmacological and psychosocial treatments for adolescents with ADHD: An updated systematic review of the literature. Clinical Psychology Review, 34(3), 218–232. https://doi.org/10.1016/j.cpr.2014.02.001
Sibley, M. H. (2016). Parent-teen therapy for executive function deficits and ADHD: Building skills and motivation. Guilford.
Sibley, M. H., Graziano, P. A., Kuriyan, A. B., Coxe, S., Pelham, W. E., Rodriguez, L., & Ward, A. (2016a). Parent–teen behavior therapy+ motivational interviewing for adolescents with ADHD. Journal of Consulting and Clinical Psychology, 84(8), 699–712. https://doi.org/10.1037/ccp0000106
Sibley, M. H., Olson, S., Morley, C., Campez, M., & Pelham, W. E., Jr. (2016b). A school consultation intervention for adolescents with ADHD: Barriers and implementation strategies. Child and Adolescent Mental Health, 21(4), 183–191. https://doi.org/10.1111/camh.12159
Sibley, M. H., Coxe, S. J., Campez, M., Morley, C., Olson, S., Hidalgo-Gato, N., & Pelham, W. E. (2018). High versus low intensity summer treatment for ADHD delivered at secondary school transitions. Journal of Clinical Child & Adolescent Psychology, 47(2), 248–265. https://doi.org/10.1080/15374416.2018.1426005
Sibley, M. H., Bickman, L., Coxe, S. J., Graziano, P. A., & Martin, P. (2020a). Community implementation of MI-enhanced behavior therapy for adolescent ADHD: Linking fidelity to effectiveness. Behavior Therapy.
Sibley, M. H., Graziano, P. A., Bickman, L., Coxe, S. J., Martin, P., Rodriguez, L. M., ... & Ortiz, M. (2020b). Implementing parent-teen motivational interviewing + behavior therapy for ADHD in community mental health. Prevention Science, 1–11.
Sibley, M. H., Graziano, P. A., Coxe, S., Bickman, L., & Martin, P. (2020c). Effectiveness of motivational interviewing−enhanced behavior therapy for adolescents with attention-deficit/hyperactivity disorder: A randomized community-based trial. Journal of the American Academy of Child & Adolescent Psychiatry.
Southam-Gerow, M. A., Weisz, J. R., Chu, B. C., McLeod, B. D., Gordis, E. B., & Connor-Smith, J. K. (2010). Does cognitive behavioral therapy for youth anxiety outperform usual care in community clinics? An initial effectiveness test. Journal of the American Academy of Child & Adolescent Psychiatry, 49(10), 1043–1052. https://doi.org/10.1016/j.jaac.2010.06.009
Southam-Gerow, M. A., Daleiden, E. L., Chorpita, B. F., Bae, C., Mitchell, C., Faye, M., & Alba, M. (2014). MAP** Los Angeles County: Taking an evidence-informed model of mental health care to scale. Journal of Clinical Child & Adolescent Psychology, 43, 190–200. https://doi.org/10.1080/15374416.2013.833098
Tanana, M., Hallgren, K. A., Imel, Z. E., Atkins, D. C., & Srikumar, V. (2016). A comparison of natural language processing methods for automated coding of motivational interviewing. Journal of Substance Abuse Treatment, 65, 43–50. https://doi.org/10.1016/j.jsat.2016.01.006
Terwiesch, C., & Ulrich, K. T. (2009). Innovation tournaments: Creating and selecting exceptional opportunities. Harvard Business Press.
Waltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., & Kirchner, J. E. (2015). Use of concept map** to characterize relationships among implementation strategies and assess their feasibility and importance: Results from the Expert Recommendations for Implementing Change (ERIC) study. Implementation Science, 10(1), 109. https://doi.org/10.1186/s13012-015-0295-0
Weisz, J. R., Southam-Gerow, M. A., Gordis, E. B., Connor-Smith, J. K., Chu, B. C., Langer, D. A., & Weiss, B. (2009). Cognitive–behavioral therapy versus usual clinical care for youth depression: An initial test of transportability to community clinics and clinicians. Journal of Consulting and Clinical Psychology, 77(3), 383. https://doi.org/10.1037/a0013877
Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., & Gray, J. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282. https://doi.org/10.1001/archgenpsychiatry.2011.147
Weisz, J. R., Ugueto, A. M., Cheron, D. M., & Herren, J. (2013). Evidence-based youth psychotherapy in the mental health ecosystem. Journal of Clinical Child & Adolescent Psychology, 42(2), 274–286. https://doi.org/10.1080/15374416.2013.764824
Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61(7), 671–689. https://doi.org/10.1037/0003-066X.61.7.671
Wolraich, M. L., Hagan, J. F., Allan, C., Chan, E., Davison, D., Earls, M., & Holbrook, J. R. (2019). Clinical practice guideline for the diagnosis, evaluation, and treatment of attention-deficit/hyperactivity disorder in children and adolescents. Pediatrics. https://doi.org/10.1542/peds.2019-2528
Wright, N., Moldavsky, M., Schneider, J., Chakrabarti, I., Coates, J., Daley, D., & Sayal, K. (2015). Practitioner review: Pathways to care for ADHD—A systematic review of barriers and facilitators. Journal of Child Psychology and Psychiatry, 56, 598–617. https://doi.org/10.1111/jcpp.12398
Funding
This trial was funded by the National Institute of Mental Health (Grant No. R01 MH106587). Dr. Sibley reports book royalties from Guilford Press for the manualized treatment described in this manuscript. This study was approved by the Florida International University Institutional Review Board and the study was performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. Informed consent was obtained from all research participants. Equator Network guidelines for reporting mixed methods research were adhered to when presenting this investigation. Drs. Sibley, Graziano, and Bickman contributed to study conceptualization and design. Drs. Sibley and Graziano, and Ms. Ortiz and Rios-Davis contributed to data coding and analysis. Drs. Sibley and Zulauf-McCurdy contributed to writing the first draft of the manuscript. All authors approved submission of the final manuscript.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Sibley, M.H., Ortiz, M., Rios-Davis, A. et al. Stakeholder-Generated Implementation Strategies to Promote Evidence-Based ADHD Treatment in Community Mental Health. Adm Policy Ment Health 49, 44–58 (2022). https://doi.org/10.1007/s10488-021-01143-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-021-01143-5