Abstract
Cross-system implementation efforts can support needed mental health (MH) service utilization among children involved in the child welfare (CW) system. The Partnering for Success (PfS) initiative is one such effort that promotes greater collaboration between the CW and MH providers by building capacity within and across each system. Frontline CW providers learn to accurately identify child MH treatment targets, link families to locally-provided evidence-based treatments (EBTs), and monitor treatment progress. Concurrently, local MH providers are trained along with CW workers to utilize Cognitive Behavioral Therapy plus Trauma-Focused CBT (CBT +), a common elements training and consultation approach focusing on typical MH issues for CW-involved children: Anxiety, Depression, Behavioral Problems, and Traumatic Stress. Finally, agency leadership receive support around promoting implementation and sustainment. This paper examines factors identified by participating CW and MH staff which impacted PfS implementation. Twenty-nine frontline, supervisory, and executive CW and MH providers were interviewed via audio-recorded web-based calls in six focus groups and 10 individual interviews. Factors facilitating implementation success included training/consultation, support from supervisors and agency leadership, improved referral processes, high quality relationships and communication between CW and MH frontline staff, PfS tools and resources, opportunities to use PfS, as well as buy-in from providers and families. Implementation barriers included poor communication between CW and MH providers, conflicts over role expectations, workload and turnover challenges, lack of buy-in, as well as provider (e.g., not aligned with CBT +) and client characteristics (e.g., frequent crises).
Similar content being viewed by others
References
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and organizational change for implementation (LOCI) A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science. https://doi.org/10.1186/s13012-014-0192-y
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. https://doi.org/10.1007/s10488-010-0327-7
Aarons, G. A., Sommerfeld, D. H., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009). The Impact of Evidence-Based Practice Implementation and Fidelity Monitoring on Staff Turnover: Evidence for a Protective Effect. Journal of Consulting and Clinical Psychology, 77(2), 270–280. https://doi.org/10.1037/a0013223
Akin, B. A., Dunkerley, S., Brook, J., & Bruns, K. (2019). Driving organization and systems change toward trauma-responsive services in child welfare: Supervisor and administrator perspectives on initial implementation. Journal of Public Child Welfare. https://doi.org/10.1080/15548732.2019.1652720
Akin, B. A., Strolin-Goltzman, J., & Collins-Camargo, C. (2017). Successes and challenges in develo** trauma-informed child welfare systems: A real-world case study of exploration and initial implementation. Children and Youth Services Review, 82, 42–52. https://doi.org/10.1016/j.childyouth.2017.09.007
Bai, Y., Wells, R., & Hillemeier, M. M. (2009). Coordination between child welfare agencies and mental health service providers, children’s service use, and outcomes. Child Abuse & Neglect, 33(6), 372–381. https://doi.org/10.1016/j.chiabu.2008.10.004
Barth, R. P., Lloyd, E. C., Christ, S. L., Chapman, M. V., & Dickinson, N. S. (2008). Child Welfare Worker Characteristics and Job Satisfaction: A National Study. Social Work (New York), 53(3), 199–209. https://doi.org/10.1093/sw/53.3.199
Barth, R. P., Rozeff, L. J., Kerns, S. E. U., & Baldwin, M. J. (2019). Partnering for Success: Implementing a cross-systems collaborative model between behavioral health and child welfare. Children and Youth Services Review. https://doi.org/10.1016/j.childyouth.2019.104663
Bartlett, J. D., Barto, B., Griffin, J. L., Fraser, J. G., Hodgdon, H., & Bodian, R. (2016). Trauma-Informed Care in the Massachusetts Child Trauma Project. Child Maltreatment, 21(2), 101–112. https://doi.org/10.1177/1077559515615700
Berliner, L., Dorsey, S., Merchant, L., Jungbluth, N., & Sedlar, G. (2013). Practical Guide for EBP Implementation in Public Mental Health. https://depts.washington.edu/hcsats/PDF/TF-%20CBT/pages/Theoretical%20Perspective/EBP%20Organization%20Practical%20Guide%202013%20Version.pdf
Blume, B. D., Kevin Ford, J., Surface, E. A., & Olenick, J. (2019). A dynamic model of training transfer. Human Resource Management Review, 29(2), 270–283. https://doi.org/10.1016/j.hrmr.2017.11.004
Bronsard, G., Alessandrini, M., Fond, G., Loundou, A., Auquier, P., Tordjman, S., & Boyer, L. (2016). The prevalence of mental disorders among children and adolescents in the child welfare system: a systematic review and meta-analysis. Medicine, 95(7), e2622. https://doi.org/10.1097/MD.0000000000002622
Bruns, E. J., & Hoagwood, K. E. (2008). State Implementation of Evidence-Based Practice for Youths, Part I: Responses to the State of the Evidence. Journal of the American Academy of Child & Adolescent Psychiatry, 47(4), 369–373. https://doi.org/10.1097/CHI.0b013e31816485f4
Bunger, A. C., Birken, S. A., Hoffman, J. A., MacDowell, H., Choy-Brown, M., & Magier, E. (2019). Elucidating the influence of supervisors’ roles on implementation climate. Implementation Science, 14(1), 93. https://doi.org/10.1186/s13012-019-0939-6
Burns, B. J., Phillips, S. D., Wagner, H. R., Barth, R. P., Kolko, D. J., Campbell, Y., & Landsverk, J. (2004). Mental health need and access to mental health services by youths involved with child welfare: a national survey. Journal of the American Academy of Child & Adolescent Psychiatry, 43(8), 960–970. https://doi.org/10.1097/01.chi.0000127590.95585.65
Casanueva, C., Ringeisen, H., Wilson, E., Smith, K., & Dolan, M. (2011). NSCAW II Baseline Report: Child Well-Being (OPRE Report #2011–27b). Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Chacko, A., Jensen, S. A., Lowry, L. S., Cornwell, M., Chimklis, A., Chan, E., Lee, D., & Pulgarin, B. (2016). Engagement in Behavioral Parent Training: Review of the Literature and Implications for Practice. Clinical Child and Family Psychology Review, 19(3), 204–215. https://doi.org/10.1007/s10567-016-0205-2
Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013). Measuring factors affecting implementation of health innovations A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science. https://doi.org/10.1186/1748-5908-8-22
Chinitz, S., Guzman, H., Amstutz, E., Kohchi, J., & Alkon, M. (2017). Improving outcomes for babies and toddlers in child welfare: A model for infant mental health intervention and collaboration. Child Abuse & Neglect, 70, 190–198. https://doi.org/10.1016/j.chiabu.2017.05.015
Chorpita, B. F., Bernstein, A., & Daleiden, E. L. (2011). Empirically guided coordination of multiple evidence-based treatments: An illustration of relevance map** in children’s mental health services. Journal of Consulting and Clinical Psychology, 79(4), 470–480. https://doi.org/10.1037/a0023982
Chuang, E., & Wells, R. (2010). The role of inter-agency collaboration in facilitating receipt of behavioral health services for youth involved with child welfare and juvenile justice. Children and Youth Services Review, 32(12), 1814–1822. https://doi.org/10.1016/j.childyouth.2010.08.002
Cohen, D., Crabtree, B. F., Hamilton, A. B., Heurtin-Roberts, S., Leeman, J., Padgett, D. K., Palinkas, L., Rabin, B., & Schacht Reisinger, H. (2018). Qualitative Methods in Implementation Science. National Institutes of Health, National Cancer Institute, Division of Cancer Control & Population Sciences. https://cancercontrol.cancer.gov/IS/docs/NCI-DCCPS-ImplementationScience-WhitePaper.pdf
Collins-Camargo, C., Strolin, J., & Akin, B. (2019). Use of technology to facilitate practice improvement in trauma-informed child welfare systems. Child Welfare, 97(3), 85–108
Crabtree, B. F., & Miller, W. L. (1999). Using codes and code manuals: A template organizing style of interpretation. In B. F. Crabtree & W. L. Miller (Eds.), Doing qualitative research in primary care: Multiple Strategies. (2nd ed., pp. 163–178). SAGE Publications. https://scholarlyworks.lvhn.org/family-medicine/44/
Daigneau, E. (2014). Why every foster kids should have an ’electronic backpack’. Governing: The Future of States and Localities. https://www.governing.com/archive/gov-why-every-foster-kid-have-electronic-backpack.html
Dedoose. (2018). Dedoose Version 8.0.35, web application for managing, analyzing, and presenting qualitative and mixed methods research data. SocioCultural Research Consultatnts, LLC. www.dedoose.com
Dorsey, S., Berliner, L., Lyon, A. R., Pullmann, M. D., & Murray, L. K. (2016). A Statewide Common Elements Initiative for Children’s Mental Health. The Journal of Behavioral Health Services & Research, 43(2), 246–261. https://doi.org/10.1007/s11414-014-9430-y
Dorsey, S., Kerns, S. E. U., Trupin, E. W., Conover, K. L., & Berliner, L. (2012). Child welfare caseworkers as service brokers for youth in foster care: findings from project focus. Child Maltreatment, 17(1), 22–31. https://doi.org/10.1177/1077559511429593
Feldstein, A. C., & Glasgow, R. E. (2008). A Practical, Robust implementation and sustainability model (PRISM) for integrating research findings into practice. The Joint Commission Journal on Quality and Patient Safety, 34(4), 228–243
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation Research: A Synthesis of the Literature. University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).
Fraser, J. G., Griffin, J. L., Barto, B. L., Lo, C., Wenz-Gross, M., Spinazzola, J., Bodian, R. A., Nisenbaum, J. M., & Bartlett, J. D. (2014). Implementation of a workforce initiative to build trauma-informed child welfare practice and services: findings from the massachusetts child trauma project. Children and Youth Services Review, 44, 233–242. https://doi.org/10.1016/j.childyouth.2014.06.016
Garland, A. F., Haine-Schlagel, R., Brookman-Frazee, L., Baker-Ericzen, M., Trask, E., & Fawley-King, K. (2013). Improving Community-Based Mental Health Care for Children: Translating Knowledge into Action. Administration and Policy in Mental Health and Mental Health Services Research, 40(1), 6–22. https://doi.org/10.1007/s10488-012-0450-8
Glisson, C. (1994). The Effect of Services Coordination Teams on Outcomes for Children in State Custody. Administration in Social Work, 18(4), 1–23. https://doi.org/10.1300/J147v18n04_01
Glisson, C., & Hemmelgarn, A. (1998). The Effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse & Neglect, 22(5), 401–421. https://doi.org/10.1016/S0145-2134(98)00005-2
Hanson, R. F., Saunders, B. E., Peer, S. O., Ralston, E., Moreland, A. D., Schoenwald, S., & Chapman, J. (2018). Community-based learning collaboratives and participant reports of interprofessional collaboration, barriers to, and utilization of child trauma services. Children and Youth Services Review, 94, 306–314. https://doi.org/10.1016/j.childyouth.2018.09.038
Hanson, R. F., Saunders, B. E., Ralston, E., Moreland, A. D., Peer, S. O., & Fitzgerald, M. M. (2019). Statewide implementation of child trauma-focused practices using the community-based learning collaborative model. Psychological Services, 16(1), 170–181. https://doi.org/10.1037/ser0000319
He, A. S., Lim, C. S., Lecklitner, G., Olson, A., & Traube, D. E. (2015). Interagency collaboration and identifying mental health needs in child welfare: Findings from Los Angeles County. Children and Youth Services Review, 53, 39–43. https://doi.org/10.1016/j.childyouth.2015.03.013
Hill, C. E., Thompson, B. J., & Williams, E. N. (1997). A Guide to conducting consensual qualitative research. Counseling Psychologist, 25(4), 517–572
Hurlburt, M. S., Leslie, L. K., Landsverk, J., Barth, R. P., Burns, B. J., Gibbons, R. D., Slymen, D. J., & Zhang, J. (2004). Contextual predictors of mental health service use among children open to child welfare. Archives of General Psychiatry, 61(12), 1217. https://doi.org/10.1001/archpsyc.61.12.1217
Hwang, S. H. J., Mollen, C. J., Kellom, K. S., Dougherty, S. L., & Noonan, K. G. (2016). Information sharing between the child welfare and behavioral health systems: Perspectives from four stakeholder groups. Social Work in Mental Health, 15(5), 500–523. https://doi.org/10.1080/15332985.2016.1252825
Kemp, S. P., Marcenko, M. O., Hoagwood, K., & Vesneski, W. (2009). Engaging parents in child welfare services: bridging family needs and child welfare mandates. Child Welfare, 88(1), 101–126
Kerns, S. E. U., Pullmann, M. D., Putnam, B., Buher, A., Holland, S., Berliner, L., Silverman, E., Payton, L., Fourre, L., Shogren, D., & Trupin, E. W. (2014). Child welfare and mental health: facilitators of and barriers to connecting children and youths in out-of-home care with effective mental health treatment. Children and Youth Services Review, 46, 315–324. https://doi.org/10.1016/j.childyouth.2014.09.013
Lang, J. M., Ake, G., Barto, B., Caringi, J., Little, C., Baldwin, M. J., Sullivan, K., Tunno, A. M., Bodian, R., Joy Stewart, C., Stevens, K., & Connell, C. M. (2017). Trauma screening in child welfare: lessons learned from five states. Journal of Child & Adolescent Trauma, 10(4), 405–416. https://doi.org/10.1007/s40653-017-0155-y
Lawrence, J., & Tar, U. (2013). The use of Grounded theory technique as a practical tool for qualitative data collection and analysis. Electronic Journal of Business Research Methods, 11, 29–40
Lyons, J. S. (2004). Redressing the emperor: Improving our children’s public mental health system. Praeger.
Metz, A., & Bartley, L. (2012). Active Implementation Frameworks for Program Success: How to Use Implementation Science to Improve Outcomes for Children. Zero to Three, 32(4), 11–18
Mor Barak, M. E., Nissly, J. A., & Levin, A. (2001). Antecedents to retention and turnover among child welfare, social work, and other human service employees: what can we learn from past research? A review and metanalysis. Social Service Review, 75(4), 625–661. https://doi.org/10.1086/323166
Murphy, J. M., Bergmann, P., Chiang, C., Sturner, R., Howard, B., Abel, M. R., & Jellinek, M. (2016). The PSC-17 subscale scores, reliability, and factor structure in a new national sample. Pediatrics. https://doi.org/10.1542/peds.2016-0038
National Child Traumatic Stress Network. (2008). Child welfare trauma training toolkit. Version 1 and 2. Center for Mental Health Services, Substance Abuse and Mental Health Services Administration.
National Implementation Research Institute. (n.d.). Active Implementation Hub Module 2: Implementation Drivers. https://nirn.fpg.unc.edu/module-2.
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: a synthesis of recommendations. Academic Medicine, 89(9), 1245–1251. https://doi.org/10.1097/ACM.0000000000000388
Palinkas, L. A., Saldana, L., Chou, C.-P., & Chamberlain, P. (2017). Use of research evidence and implementation of evidence-based practices in youth-serving systems. Children and Youth Services Review, 83, 242–247. https://doi.org/10.1016/j.childyouth.2017.11.005
Patton, M. Q. (2014). Qualitative research & evaluation methods: integrating theory and practice. Sage Publications Inc.
Pham, L. (2018). A Review of key paradigms: Positivism, interpretivism and critical inquiry. https://doi.org/https://doi.org/10.13140/RG.2.2.13995.54569
Pullmann, M. D., Jacobson, J., Parker, E., Cevasco, M., Uomoto, J. A., Putnam, B. J., Benshoof, T., & Kerns, S. E. U. (2018). Tracing the pathway from mental health screening to services for children and youth in foster care. Children and Youth Services Review, 89, 340–354. https://doi.org/10.1016/j.childyouth.2018.04.038
Rivard, J. C., Johnsen, M. C., Morrissey, J. P., & Starrett, B. E. (1999). The dynamics of interagency collaboration: how linkages develop for child welfare and juvenile justice sectors in a system of care demonstration. Journal of Social Service Research, 25(3), 61–82. https://doi.org/10.1300/J079v25n03_05
Stiffman, A. R., Pescosolido, B., & Cabassa, L. J. (2004). Building a model to understand youth service access: The gateway provider model. Mental Health Services Research, 6(4), 189–198. https://doi.org/10.1023/b:mhsr.0000044745.09952.33
Stiffman, A. R., Striley, C., Horvath, V. E., Hadley-Ives, E., Polgar, M., Elze, D., & Pescarino, R. (2001). Organizational context and provider perception as determinants of mental health service use. The Journal of Behavioral Health Services & Research, 28(2), 188–204. https://doi.org/10.1007/BF02287461
Sullivan, A. D., Breslend, N. L., Strolin-Goltzman, J., Bielawski-Branch, A., Jorgenson, J., Deaver, A. H., Forehand, G., & Forehand, R. (2019). Feasibility investigation: Leveraging smartphone technology in a trauma and behavior management-informed training for foster caregivers. Children and Youth Services Review, 101, 363–371. https://doi.org/10.1016/j.childyouth.2019.03.051
United States. (2004). The Health Insurance Portability and Accountability Act (HIPAA). U.S. Dept. of Labor.
U.S. Census Bureau. (2020, September 15). Income, Poverty and Health Insurance Coverage in the United States: 2019. Retrieved from https://www.census.gov/newsroom/press-releases/2020/income-poverty.html
Verbist, A. N., Winters, A., Collins-Camargo, C., & Antle, B. (2020). Standardized assessment domains as predictors of prescription of trauma-focused treatment for youth in out-of-home care. Children and Youth Services Review. https://doi.org/10.1016/j.childyouth.2020.105401
Winters, A. M., Collins-Camargo, C., Antle, B. F., & Verbist, A. N. (2020). Implementation of system-wide change in child welfare and behavioral health: The role of capacity, collaboration, and readiness for change. Children and Youth Services Review, 108, 104580. https://doi.org/10.1016/j.childyouth.2019.104580
Wisdom, J. P., Lewandowski, R. E., Pollock, M., Acri, M., Shorter, P., Olin, S. S., Armusewicz, K., Horwitz, S., & Hoagwood, K. E. (2014). What Family Support Specialists Do: Examining Service Delivery. Administration And Policy In Mental Health And Mental Health Services Research, 41(1), 21–31
Woltmann, E. M., Whitley, R., McHugo, G. J., Brunette, M., Torrey, W. C., Coots, L., Lynde, D., & Drake, R. E. (2008). The role of staff turnover in the implementation of evidence-based practices in mental health care. Psychiatric Services, 59(7), 732–737. https://doi.org/10.1176/appi.ps.59.7.732
Woodard, G. S., Triplett, N. S., Martin, P., Meza, R. D., Lyon, A. R., Berliner, L., & Dorsey, S. (2020). Implementing mental health services for children and adolescents caregiver involvement in school-based care. Psychiatric Services, 71(1), 79–82. https://doi.org/10.1176/appi.ps.201900160
Acknowledgement
The authors acknowledge support from the UMSSW's Ruth H. Young Center for Families and Children and the Institute for Innovation and Implementation. We also thank the child welfare and mental health agency leaders, line professionals, providers and their clients who participated in the evaluation. The authors recognize the significant contributions of Rick Barth, Lucy Berliner, John Cosgrove, Shannon Dorsey, Pamela Freeman, Angela Jachelski, Bethany Lee, Marc Mannes, Jon Phillips, Karen Powell, Leslie Rozeff, Rochon Steward, and Jessie Watrous.
Funding
Partnering for Success is a program of the National Center for Evidence-Based Practice in Child Welfare which is supported through grant 90CT7001-01-02 from the U.S. Department of Health and Human Services, Administration for Children Youth and Families, Children’s Bureau. Funding support was also provided by the Children’s Bureau through the State of Maryland’s Title IV-E Waiver Demonstration project. The National Center for Evidence-Based Practice in Child Welfare (NCEBPCW) is operated by the University of Maryland, School of Social Work (UMSSW). The contents of this paper/presentation are solely the responsibility of the NCEBPCW and do not necessarily represent the official views of the Children’s Bureau of the US Department of Health and Human Services.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed Consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original version of this article was revised: Author name in Reference Woodard 2020 has been corrected.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Gopalan, G., Kerns, S.E.U., Horen, M.J. et al. Partnering for Success: Factors Impacting Implementation of a Cross-Systems Collaborative model Between Behavioral Health and Child Welfare. Adm Policy Ment Health 48, 839–856 (2021). https://doi.org/10.1007/s10488-021-01135-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-021-01135-5