Abstract
There is limited use of empirically supported mental health interventions in schools. Leveraging technology may reduce some barriers, however, use may still be limited. To further understand variable intervention use, this study investigated the challenges experienced by teachers invited to implement a daily report card (DRC) intervention aided by an interactive website called the DRC.Online (DRC.O). The DRC is a structured approach to the delivery of a tailored positive reinforcement intervention to support individual students struggling with attention and/or behavior difficulties delivered by teachers with daily feedback to the student themselves and their caregivers. The study was embedded within a pilot rollout of the DRC.O in elementary schools in two school districts in Canada. Data for this qualitative inquiry were derived from 21 semi-structured interviews and two focus groups conducted with teachers and other school personnel who had varying levels of DRC.O use. A descriptive qualitative approach was used. Five constructs were identified: (1) Intervention Demands for the Teacher, (2) Finding and Creating a Fit for the Intervention, (3) Perceived Focus on the Negatives, (4) Managing Technological Components, and (5) Influencing Contextual Factors. Each construct contains aspects of challenges that may have influenced the extent of use of the DRC.O. Some of the identified factors overlap with challenges identified in previous studies of intervention implementation; however, details within the above constructs identify additional nuances that may inform specific adjustments that may improve uptake and implementation.
Similar content being viewed by others
Availability of Data and Material
Data not available for use outside of original research team.
Code Availability
Not applicable.
References
Atkins, M. S., Hoagwood, K. E., Kutash, K., & Seidman, E. (2010). Toward the integration of education and mental health in schools. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 40–47. https://doi.org/10.1007/s10488-010-0299-7.
Bambara, L. M., Nonnemacher, S., & Kern, L. (2009). Sustaining school-based individualized positive behavior support: perceived barriers and enablers. Journal of Positive Behavior Interventions, 11(3), 161–177.
Barwick, M., Barac, R., Akrong, L. M., Johnson, S., & Chaban, P. (2014). Bringing evidence to the classroom: Exploring educator notions of evidence and preferences for practice change. International Education Research, 2(4), 1–15.
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101.
Brownson, R. C., Jacobs, J. A., Tabak, R. G., Hoehner, C. M., & Stamatakis, K. A. (2013). Designing for dissemination among public health researchers: Findings from a national survey in the United States. American Journal of Public Health, 103(9), 1693–1699. https://doi.org/10.2105/AJPH.2012.301165.
Cappella, E., Jackson, D. R., Kim, H. Y., Bilal, C., Holland, S., & Atkins, M. S. (2016). Implementation of teacher consultation and coaching in urban schools: A mixed method study. School Mental Health, 8(2), 222–237.
Collier-Meek, M. A., Sanetti, L. M. H., & Boyle, A. M. (2019). Barriers to implementing classroom management and behavior support plans: An exploratory investigation. Psychology in the Schools, 56(1), 5–17. https://doi.org/10.1002/pits.22127.
Committee on School Health. (2004). School-based mental health services. Pediatrics, 113(6), 11839–11845.
Connors, E. H., Schiffman, J., Stein, K., LeDoux, S., Landsverk, J., & Hoover, S. (2019). Factors associated with community-partnered school behavioral health clinicians’ adoption and implementation of evidence-based practices. Administration and Policy in Mental Health and Mental Health Services Research, 46(1), 91–104. https://doi.org/10.1007/s10488-018-0897-3.
Fabiano, G. A., & Evans, S. W. (2019). Introduction to the special issue of school mental health on best practices in effective multi-tiered intervention frameworks. School Mental Health, 11(1), 1–3. https://doi.org/10.1007/s12310-018-9283-2.
Fabiano, G. A., & Pyle, K. (2019). Best practices in school mental health for attention-deficit/hyperactivity disorder: A framework for intervention. School Mental Health, 11(1), 72–91. https://doi.org/10.1007/s12310-018-9267-2.
Farley-Ripple, E., & Buttram, J. (2015). The development of capacity for data use: The role of teacher networks in an elementary school. Teachers College Record, 117(4), 1–34.
Georgiades, K., Duncan, L., Wang, L., Comeau, J., & Boyle, M. H. (2019). Six-month prevalence of mental disorders and service contacts among children and youth in Ontario: evidence from the 2014 Ontario Child Health Study. Canadian Journal of Psychiatry, 64(4), 246–255. https://doi.org/10.1177/0706743719830024.
Goodman, R. (1997). The strengths and difficulties questionnaire: A research note. Journal of Child Psychology and Psychiatry and Allied Disciplines, 38(5), 581–586.
Greenhalgh, T., & Taylor, R. (1997). How to read a paper: Papers that go beyond numbers (qualitative research). BMJ, 315(7110), 740–743.
Hart, K. C., Fabiano, G. A., Evans, S. W., Manos, M. J., Hannah, J. N., & Vujnovic, R. K. (2017). Elementary and middle school teachers’ self-reported use of positive behavioral supports for children with ADHD: A national survey. Journal of Emotional and Behavioral Disorders, 25(4), 246–256.
Kincaid, D., Childs, K., Blase, K. A., & Wallace, F. (2007). Identifying barriers and facilitators in implementing schoolwide positive behavior support. Journal of Positive Behavior Interventions, 9(3), 174–184. https://doi.org/10.1177/10983007070090030501.
Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2(3), 105–113.
Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., et al. (2018). From classification to causality: Advancing understanding of mechanisms of change in implementation science. Frontiers in Public Health, 6, 136. https://doi.org/10.3389/fpubh.2018.00136.
Lohrmann, S., Forman, S., Martin, S., & Palmieri, M. (2008). Understanding school personnel’s resistance to adopting schoolwide positive behavior support at a universal level of intervention. Journal of Positive Behavior Interventions, 10(4), 256–269. https://doi.org/10.1177/1098300708318963.
Long, A. C. J., Hagermoser Sanetti, L. M., Collier-Meek, M. A., Gallucci, J., Altschaefl, M., & Kratochwill, T. R. (2016). An exploratory investigation of teachers’ intervention planning and perceived implementation barriers. Journal of School Psychology, 55, 1–26. https://doi.org/10.1016/j.jsp.2015.12.002.
Martinussen, R., Tannock, R., & Chaban, P. (2011). Teachers’ reported use of instructional and behavior management practices for students with behavior problems: Relationship to role and level of training in ADHD. Child & Youth Care Forum, 40(3), 193–210. https://doi.org/10.1007/s10566-010-9130-6.
McLennan, J. D. (2010). Adopting parenting interventions in a Canadian community: Processes contributing to research-practice gaps. Canadian Journal of Community Mental Health, 29(1), 95–106. https://doi.org/10.7870/cjcmh-2010-0008.
McLennan, J. D. (2018). Behavioural consultation to schools via telehealth: The medium is not the message. International Journal of Qualitative Methods, 17(1), 34.
Mills, C., Stephan, S. H., Moore, E., Weist, M. D., Daly, B. P., & Edwards, M. (2006). The president’s new freedom commission: Capitalizing on opportunities to advance school-based mental health services. Clinical Child and Family Psychology Review, 9(3–4), 149–161. https://doi.org/10.1007/s10567-006-0003-3.
Mixon, C., Owens, J., Hustus, C., Serrano, V., & Holdaway, A. (2019). Evaluating the impact of online professional development on teachers’ use of a targeted behavioral classroom intervention. School Mental Health, 11(1), 115–128.
Mumtaz, S. (2000). Factors affecting teachers’ use of information and communications technology: A review of the literature. Journal of Information Technology for Teacher Education, 9(3), 319–342. https://doi.org/10.1080/14759390000200096.
Newman, D. S., Hazel, C. E., Barrett, C. A., Chaudhuri, S. D., & Fetterman, H. (2018). Early-career school psychologists’ perceptions of consultative service delivery: The more things change, the more they stay the same. Journal of Educational and Psychological Consultation, 28(2), 105–136.
Owens, J. S., et al. (2020). Cost-effectiveness of consultation for a daily report card intervention: Comparing online and in-person implementation supports. Journal of Educational and Psychological Consultation, pp. 1–28.
Owens, J. S., Holdaway, A. S., Zoromski, A. K., Evans, S. W., Himawan, L. K., Girio-Herrera, E., et al. (2012). Incremental benefits of a daily report card intervention over time for youth with disruptive behavior. Behavior Therapy, 43(4), 848–861.
Owens, J. S., Hustus, C. L., & Evans, S. W. (2020). The daily report card intervention: Summary of the science and factors affecting implementation. In T. Farmer, M. Conroy, B. Farmer, & K. Sutherland (Eds.), Handbook of research on emotional and behavioral disabilities: Interdisciplinary developmental perspectives on children and youth (pp. 371–385). London: Routledge Press.
Owens, J. S., McLennan, J. D., Hustus, C. L., Haines-Saah, R., Mitchell, S., Mixon, C. S., et al. (2019). Leveraging technology to facilitate teachers’ use of a targeted classroom intervention: Evaluation of the Daily Report Card.Online (DRC.O) system. School Mental Health, 11(4), 665–677. https://doi.org/10.1007/s12310-019-09320-6.
Pope, C., & Mays, N. (1995). Qualitative research: Reaching the parts other methods cannot reach: An introduction to qualitative methods in health and health services research. BMJ, 311(6996), 42. https://doi.org/10.1136/bmj.311.6996.42.
Pyle, K., & Fabiano, G. A. (2017). Daily report card intervention and attention deficit hyperactivity disorder: A meta-analysis of single-case studies. Exceptional Children, 83(4), 378–395. https://doi.org/10.1177/0014402917706370.
Rogers, E. M. (1995). Diffusion of innovation (4th ed.). New York: The Free Press.
Sale, J. E. M., Lohfeld, L. H., & Brazil, K. (2002). Revisiting the quantitative-qualitative debate: Implications for mixed-methods research. Quality & Quantity, 36(1), 43–53. https://doi.org/10.1023/A:1014301607592.
Sanchez, A. L., Cornacchio, D., Poznanski, B., Golik, A., Chou, T., & Comer, J. S. (2018). The effectiveness of school-based mental health services for elementary-aged children: A meta-analysis. Journal of the American Academy of Child and Adolescent Psychiatry, 57(3), 153–165. https://doi.org/10.1016/j.jaac.2017.11.022.
Sandelowski, M. (2000). Focus on research methods: Whatever happened to qualitative description? Research in Nursing & Health, 23(4), 334–340. https://doi.org/10.1002/1098-240X(200008)23:43.0.CO;2-G.
Solomon, B. G., Klein, S. A., & Politylo, B. C. (2012). The effect of performance feedback on teachers’ treatment integrity: A meta-analysis of the single-case literature. School Psychology Review, 41(2), 160–175.
Stith, S., Pruitt, I., Dees, J., Fronce, M., Green, N., Som, A., et al. (2006). Implementing community-based prevention programming: A review of the literature. Journal of Primary Prevention, 27(6), 599–617. https://doi.org/10.1007/s10935-006-0062-8.
Tariq, S., & Woodman, J. (2013). Using mixed methods in health research. JRSM Short Reports, 4(6), 204253331347919. https://doi.org/10.1177/2042533313479197.
Vannest, K. J., Davis, J. L., Davis, C. R., Mason, B. A., & Burke, M. D. (2010). Effective intervention for behavior with a daily behavior report card: A meta-analysis. School Psychology Digest, 39(4), 654–672.
Acknowledgements
The authors express their gratitude to the educators, administrators, and families in the participating school districts for their collaboration.
Funding
PolicyWise for Children and Families. The opinions expressed are those of the authors and do not represent views of PolicyWise.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
J Owens receives no financial benefit from the DRC.O program, but is the primary developer of the website. Other authors have no conflicts of interest to disclose.
Consent to Participate
Written informed consent obtained from all participants.
Consent for Publication
There are no restrictions on publication.
Ethics Approval
Ethics approval received from participating university institutions and schoolboards. All procedures were performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
McLennan, J.D., Owens, J.S., Haines-Saah, R. et al. Understanding Barriers to Teacher Use of a Daily Report Card Intervention Aided by Online Implementation Support. School Mental Health 12, 826–840 (2020). https://doi.org/10.1007/s12310-020-09389-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12310-020-09389-4