Log in

Understanding Barriers to Teacher Use of a Daily Report Card Intervention Aided by Online Implementation Support

  • Original Paper
  • Published:
School Mental Health Aims and scope Submit manuscript

Abstract

There is limited use of empirically supported mental health interventions in schools. Leveraging technology may reduce some barriers, however, use may still be limited. To further understand variable intervention use, this study investigated the challenges experienced by teachers invited to implement a daily report card (DRC) intervention aided by an interactive website called the DRC.Online (DRC.O). The DRC is a structured approach to the delivery of a tailored positive reinforcement intervention to support individual students struggling with attention and/or behavior difficulties delivered by teachers with daily feedback to the student themselves and their caregivers. The study was embedded within a pilot rollout of the DRC.O in elementary schools in two school districts in Canada. Data for this qualitative inquiry were derived from 21 semi-structured interviews and two focus groups conducted with teachers and other school personnel who had varying levels of DRC.O use. A descriptive qualitative approach was used. Five constructs were identified: (1) Intervention Demands for the Teacher, (2) Finding and Creating a Fit for the Intervention, (3) Perceived Focus on the Negatives, (4) Managing Technological Components, and (5) Influencing Contextual Factors. Each construct contains aspects of challenges that may have influenced the extent of use of the DRC.O. Some of the identified factors overlap with challenges identified in previous studies of intervention implementation; however, details within the above constructs identify additional nuances that may inform specific adjustments that may improve uptake and implementation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Similar content being viewed by others

Availability of Data and Material

Data not available for use outside of original research team.

Code Availability

Not applicable.

References

  • Atkins, M. S., Hoagwood, K. E., Kutash, K., & Seidman, E. (2010). Toward the integration of education and mental health in schools. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 40–47. https://doi.org/10.1007/s10488-010-0299-7.

    Article  PubMed  Google Scholar 

  • Bambara, L. M., Nonnemacher, S., & Kern, L. (2009). Sustaining school-based individualized positive behavior support: perceived barriers and enablers. Journal of Positive Behavior Interventions, 11(3), 161–177.

    Article  Google Scholar 

  • Barwick, M., Barac, R., Akrong, L. M., Johnson, S., & Chaban, P. (2014). Bringing evidence to the classroom: Exploring educator notions of evidence and preferences for practice change. International Education Research, 2(4), 1–15.

  • Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101.

    Article  Google Scholar 

  • Brownson, R. C., Jacobs, J. A., Tabak, R. G., Hoehner, C. M., & Stamatakis, K. A. (2013). Designing for dissemination among public health researchers: Findings from a national survey in the United States. American Journal of Public Health, 103(9), 1693–1699. https://doi.org/10.2105/AJPH.2012.301165.

    Article  PubMed  PubMed Central  Google Scholar 

  • Cappella, E., Jackson, D. R., Kim, H. Y., Bilal, C., Holland, S., & Atkins, M. S. (2016). Implementation of teacher consultation and coaching in urban schools: A mixed method study. School Mental Health, 8(2), 222–237.

  • Collier-Meek, M. A., Sanetti, L. M. H., & Boyle, A. M. (2019). Barriers to implementing classroom management and behavior support plans: An exploratory investigation. Psychology in the Schools, 56(1), 5–17. https://doi.org/10.1002/pits.22127.

    Article  Google Scholar 

  • Committee on School Health. (2004). School-based mental health services. Pediatrics, 113(6), 11839–11845.

    Article  Google Scholar 

  • Connors, E. H., Schiffman, J., Stein, K., LeDoux, S., Landsverk, J., & Hoover, S. (2019). Factors associated with community-partnered school behavioral health clinicians’ adoption and implementation of evidence-based practices. Administration and Policy in Mental Health and Mental Health Services Research, 46(1), 91–104. https://doi.org/10.1007/s10488-018-0897-3.

    Article  PubMed  Google Scholar 

  • Fabiano, G. A., & Evans, S. W. (2019). Introduction to the special issue of school mental health on best practices in effective multi-tiered intervention frameworks. School Mental Health, 11(1), 1–3. https://doi.org/10.1007/s12310-018-9283-2.

    Article  Google Scholar 

  • Fabiano, G. A., & Pyle, K. (2019). Best practices in school mental health for attention-deficit/hyperactivity disorder: A framework for intervention. School Mental Health, 11(1), 72–91. https://doi.org/10.1007/s12310-018-9267-2.

    Article  Google Scholar 

  • Farley-Ripple, E., & Buttram, J. (2015). The development of capacity for data use: The role of teacher networks in an elementary school. Teachers College Record, 117(4), 1–34.

    Google Scholar 

  • Georgiades, K., Duncan, L., Wang, L., Comeau, J., & Boyle, M. H. (2019). Six-month prevalence of mental disorders and service contacts among children and youth in Ontario: evidence from the 2014 Ontario Child Health Study. Canadian Journal of Psychiatry, 64(4), 246–255. https://doi.org/10.1177/0706743719830024.

    Article  PubMed  Google Scholar 

  • Goodman, R. (1997). The strengths and difficulties questionnaire: A research note. Journal of Child Psychology and Psychiatry and Allied Disciplines, 38(5), 581–586.

    Article  Google Scholar 

  • Greenhalgh, T., & Taylor, R. (1997). How to read a paper: Papers that go beyond numbers (qualitative research). BMJ, 315(7110), 740–743.

    Article  Google Scholar 

  • Hart, K. C., Fabiano, G. A., Evans, S. W., Manos, M. J., Hannah, J. N., & Vujnovic, R. K. (2017). Elementary and middle school teachers’ self-reported use of positive behavioral supports for children with ADHD: A national survey. Journal of Emotional and Behavioral Disorders, 25(4), 246–256.

    Article  Google Scholar 

  • Kincaid, D., Childs, K., Blase, K. A., & Wallace, F. (2007). Identifying barriers and facilitators in implementing schoolwide positive behavior support. Journal of Positive Behavior Interventions, 9(3), 174–184. https://doi.org/10.1177/10983007070090030501.

    Article  Google Scholar 

  • Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2(3), 105–113.

    Article  Google Scholar 

  • Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., et al. (2018). From classification to causality: Advancing understanding of mechanisms of change in implementation science. Frontiers in Public Health, 6, 136. https://doi.org/10.3389/fpubh.2018.00136.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lohrmann, S., Forman, S., Martin, S., & Palmieri, M. (2008). Understanding school personnel’s resistance to adopting schoolwide positive behavior support at a universal level of intervention. Journal of Positive Behavior Interventions, 10(4), 256–269. https://doi.org/10.1177/1098300708318963.

    Article  Google Scholar 

  • Long, A. C. J., Hagermoser Sanetti, L. M., Collier-Meek, M. A., Gallucci, J., Altschaefl, M., & Kratochwill, T. R. (2016). An exploratory investigation of teachers’ intervention planning and perceived implementation barriers. Journal of School Psychology, 55, 1–26. https://doi.org/10.1016/j.jsp.2015.12.002.

    Article  PubMed  Google Scholar 

  • Martinussen, R., Tannock, R., & Chaban, P. (2011). Teachers’ reported use of instructional and behavior management practices for students with behavior problems: Relationship to role and level of training in ADHD. Child & Youth Care Forum, 40(3), 193–210. https://doi.org/10.1007/s10566-010-9130-6.

    Article  Google Scholar 

  • McLennan, J. D. (2010). Adopting parenting interventions in a Canadian community: Processes contributing to research-practice gaps. Canadian Journal of Community Mental Health, 29(1), 95–106. https://doi.org/10.7870/cjcmh-2010-0008.

    Article  Google Scholar 

  • McLennan, J. D. (2018). Behavioural consultation to schools via telehealth: The medium is not the message. International Journal of Qualitative Methods, 17(1), 34.

    Google Scholar 

  • Mills, C., Stephan, S. H., Moore, E., Weist, M. D., Daly, B. P., & Edwards, M. (2006). The president’s new freedom commission: Capitalizing on opportunities to advance school-based mental health services. Clinical Child and Family Psychology Review, 9(3–4), 149–161. https://doi.org/10.1007/s10567-006-0003-3.

    Article  PubMed  Google Scholar 

  • Mixon, C., Owens, J., Hustus, C., Serrano, V., & Holdaway, A. (2019). Evaluating the impact of online professional development on teachers’ use of a targeted behavioral classroom intervention. School Mental Health, 11(1), 115–128.

    Article  Google Scholar 

  • Mumtaz, S. (2000). Factors affecting teachers’ use of information and communications technology: A review of the literature. Journal of Information Technology for Teacher Education, 9(3), 319–342. https://doi.org/10.1080/14759390000200096.

    Article  Google Scholar 

  • Newman, D. S., Hazel, C. E., Barrett, C. A., Chaudhuri, S. D., & Fetterman, H. (2018). Early-career school psychologists’ perceptions of consultative service delivery: The more things change, the more they stay the same. Journal of Educational and Psychological Consultation, 28(2), 105–136.

  • Owens, J. S., et al. (2020). Cost-effectiveness of consultation for a daily report card intervention: Comparing online and in-person implementation supports. Journal of Educational and Psychological Consultation, pp. 1–28.

  • Owens, J. S., Holdaway, A. S., Zoromski, A. K., Evans, S. W., Himawan, L. K., Girio-Herrera, E., et al. (2012). Incremental benefits of a daily report card intervention over time for youth with disruptive behavior. Behavior Therapy, 43(4), 848–861.

    Article  Google Scholar 

  • Owens, J. S., Hustus, C. L., & Evans, S. W. (2020). The daily report card intervention: Summary of the science and factors affecting implementation. In T. Farmer, M. Conroy, B. Farmer, & K. Sutherland (Eds.), Handbook of research on emotional and behavioral disabilities: Interdisciplinary developmental perspectives on children and youth (pp. 371–385). London: Routledge Press.

    Chapter  Google Scholar 

  • Owens, J. S., McLennan, J. D., Hustus, C. L., Haines-Saah, R., Mitchell, S., Mixon, C. S., et al. (2019). Leveraging technology to facilitate teachers’ use of a targeted classroom intervention: Evaluation of the Daily Report Card.Online (DRC.O) system. School Mental Health, 11(4), 665–677. https://doi.org/10.1007/s12310-019-09320-6.

    Article  Google Scholar 

  • Pope, C., & Mays, N. (1995). Qualitative research: Reaching the parts other methods cannot reach: An introduction to qualitative methods in health and health services research. BMJ, 311(6996), 42. https://doi.org/10.1136/bmj.311.6996.42.

    Article  PubMed  PubMed Central  Google Scholar 

  • Pyle, K., & Fabiano, G. A. (2017). Daily report card intervention and attention deficit hyperactivity disorder: A meta-analysis of single-case studies. Exceptional Children, 83(4), 378–395. https://doi.org/10.1177/0014402917706370.

    Article  Google Scholar 

  • Rogers, E. M. (1995). Diffusion of innovation (4th ed.). New York: The Free Press.

    Google Scholar 

  • Sale, J. E. M., Lohfeld, L. H., & Brazil, K. (2002). Revisiting the quantitative-qualitative debate: Implications for mixed-methods research. Quality & Quantity, 36(1), 43–53. https://doi.org/10.1023/A:1014301607592.

    Article  Google Scholar 

  • Sanchez, A. L., Cornacchio, D., Poznanski, B., Golik, A., Chou, T., & Comer, J. S. (2018). The effectiveness of school-based mental health services for elementary-aged children: A meta-analysis. Journal of the American Academy of Child and Adolescent Psychiatry, 57(3), 153–165. https://doi.org/10.1016/j.jaac.2017.11.022.

    Article  PubMed  Google Scholar 

  • Sandelowski, M. (2000). Focus on research methods: Whatever happened to qualitative description? Research in Nursing & Health, 23(4), 334–340. https://doi.org/10.1002/1098-240X(200008)23:43.0.CO;2-G.

    Article  Google Scholar 

  • Solomon, B. G., Klein, S. A., & Politylo, B. C. (2012). The effect of performance feedback on teachers’ treatment integrity: A meta-analysis of the single-case literature. School Psychology Review, 41(2), 160–175.

    Article  Google Scholar 

  • Stith, S., Pruitt, I., Dees, J., Fronce, M., Green, N., Som, A., et al. (2006). Implementing community-based prevention programming: A review of the literature. Journal of Primary Prevention, 27(6), 599–617. https://doi.org/10.1007/s10935-006-0062-8.

    Article  PubMed  Google Scholar 

  • Tariq, S., & Woodman, J. (2013). Using mixed methods in health research. JRSM Short Reports, 4(6), 204253331347919. https://doi.org/10.1177/2042533313479197.

    Article  Google Scholar 

  • Vannest, K. J., Davis, J. L., Davis, C. R., Mason, B. A., & Burke, M. D. (2010). Effective intervention for behavior with a daily behavior report card: A meta-analysis. School Psychology Digest, 39(4), 654–672.

    Article  Google Scholar 

Download references

Acknowledgements

The authors express their gratitude to the educators, administrators, and families in the participating school districts for their collaboration.

Funding

PolicyWise for Children and Families. The opinions expressed are those of the authors and do not represent views of PolicyWise.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to John D. McLennan.

Ethics declarations

Conflict of interest

J Owens receives no financial benefit from the DRC.O program, but is the primary developer of the website. Other authors have no conflicts of interest to disclose.

Consent to Participate

Written informed consent obtained from all participants.

Consent for Publication

There are no restrictions on publication.

Ethics Approval

Ethics approval received from participating university institutions and schoolboards. All procedures were performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

McLennan, J.D., Owens, J.S., Haines-Saah, R. et al. Understanding Barriers to Teacher Use of a Daily Report Card Intervention Aided by Online Implementation Support. School Mental Health 12, 826–840 (2020). https://doi.org/10.1007/s12310-020-09389-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12310-020-09389-4

Keywords

Navigation