Log in

The lived experience of Competence by Design: Canadian resident physicians’ perspectives

L’expérience vécue de la compétence par conception : les points de vue des médecins résident·es canadien·nes

  • Reports of Original Investigations
  • Published:
Canadian Journal of Anesthesia/Journal canadien d'anesthésie Aims and scope Submit manuscript

Abstract

Purpose

Canadian specialist residency programs are in the process of transitioning to a hybrid time and competence model, Competence by Design (CBD), developed by the Royal College of Physicians and Surgeons Canada. Although there is extensive literature around competency-based medical education (CBME), few studies have evaluated the experience of residents after CBME implementation. The purpose of this study was to obtain a rich perspective on the lived experience of residents.

Methods

We designed a qualitative study with inductive thematic analysis of semistructured interview data. The study population was residents in CBD postgraduate training programs in anesthesiology, internal medicine, or surgery (including all surgical subspecialties) at Dalhousie University (Halifax, NS, Canada).

Results

Residents identified the following benefits of their programs and CBD: supportive peers and clinical supervisors, a roadmap for residency, formalized feedback opportunities, and program evolution. Resident-identified drawbacks of CBD included: a lack of transparency around CBD, CBD not as advertised, a lack of buy-in, increased administrative burden, difficulties obtaining evidence for entrustable professional activities (EPAs); the onus for CBD on residents, inconsistent feedback, cumbersome technology, and significant psychological burden. Resident-suggested improvements were reducing the number of EPAs, streamlining EPA requirements, increasing transparency and communication with competence committees, providing incentives and continuous education for clinical supervisors, improving on existing electronic interfaces, and develo** technology better suited to the needs of CBD.

Conclusion

This study highlights that the significant administrative and psychological burden of CBD detracts from clinical learning and enthusiasm for residency. Future research could explore whether overcoming the identified challenges will improve residents’ experiences.

Résumé

Objectif

Les programmes canadiens de résidence spécialisée sont en train de passer à un modèle hybride de temps et de compétence, soit la compétence par conception (CPC); ce modèle a été élaboré par le Collège royal des médecins et chirurgiens du Canada. Bien qu’il existe une abondante documentation sur la formation médicale fondée sur les compétences (FMFC), peu d’études ont évalué l’expérience des résidentes et résidents après la mise en œuvre de la FMFC. Le but de cette étude était d’obtenir une perspective enrichie quant à l’expérience vécue par les résidents et résidentes.

Méthode

Nous avons conçu une étude qualitative avec une analyse thématique inductive des données d’entretiens semi-structurés. La population étudiée était composée de résident·es des programmes de formation postdoctorale en anesthésiologie, en médecine interne ou en chirurgie (y compris toutes les surspécialités chirurgicales) à l’Université Dalhousie (Halifax, N.-É., Canada).

Résultats

Les personnes interrogées ont identifié les avantages suivants de leurs programmes et de la CPC : le soutien des pairs et des superviseur·es cliniques, une feuille de route pour la résidence, des possibilités de rétroaction officielles et l’évolution du programme. Parmi les inconvénients de la CPC identifiés par les résident·es, mentionnons : un manque de transparence autour de la CPC, une CPC ne correspondant pas à ce qui avait été annoncé, un manque d’adhésion, un fardeau administratif accru, des difficultés à obtenir des preuves de participation à des actes professionnels non supervisés (APNS); le fardeau de la CPC incombant aux résident·es, une rétroaction incohérente, une technologie lourde et un fardeau psychologique important. Les améliorations suggérées par les résident·es comprenaient la réduction du nombre d’APNS, la rationalisation des exigences des APNS, l’augmentation de la transparence et de la communication avec les comités de compétence, l’offre d’incitations et de formation continue aux superviseur·es cliniques, l’amélioration des interfaces électroniques existantes et le développement d’une technologie mieux adaptée aux besoins de la CPC.

Conclusion

Cette étude souligne que le fardeau administratif et psychologique important de la CPC nuit à l’apprentissage clinique et à l’enthousiasme pour la résidence. Les recherches futures pourraient déterminer si le fait de surmonter les défis identifiés améliorerait l’expérience des résidentes et résidents.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Germany)

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Fraser AB, Stodel EJ, Chaput AJ. Curriculum reform for residency training: competence, change, and opportunities for leadership. Can J Anesth 2016; 63: 875–84. https://doi.org/10.1007/s12630-016-0637-7

    Article  PubMed  Google Scholar 

  2. Crosson FJ, Leu J, Roemer BM, Ross MN. Gaps in residency training should be addressed to better prepare doctors for a twenty-first-century delivery system. Health Aff (Millwood) 2011; 30: 2142–8. https://doi.org/10.1377/hlthaff.2011.0184

    Article  PubMed  Google Scholar 

  3. Mattar SG, Alseidi AA, Jones DB, et al. General surgery residency inadequately prepares trainees for fellowship: results of a survey of fellowship program directors. Ann Surg 2013; 258: 440–9. https://doi.org/10.1097/sla.0b013e3182a191ca

    Article  PubMed  Google Scholar 

  4. Frenk J, Chen L, Bhutta ZA, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet 2010; 376: 1923–58. https://doi.org/10.1016/s0140-6736(10)61854-5

    Article  PubMed  Google Scholar 

  5. Caverzagie KJ, Nousiainen MT, Ferguson PC, et al. Overarching challenges to the implementation of competency-based medical education. Med Teach 2017; 39: 588–93. https://doi.org/10.1080/0142159x.2017.1315075

    Article  PubMed  Google Scholar 

  6. Royal College of Physicians and Surgeons of Canada. CanMEDS: better standards, better physicians, better care. Available from URL: https://www.royalcollege.ca/rcsite/canmeds/canmeds-framework-e (accessed July 2023).

  7. Royal College of Physicians and Surgeons of Canada. Canada’s home for specialty medicine. Available from URL: https://www.royalcollege.ca/ca/en/about/our-history.html (accessed July 2023).

  8. Dalhousie University. About CBME. Available from URL: https://medicine.dal.ca/departments/core-units/postgraduate/cbme/about-cbme.html (accessed July 2023).

  9. Royal College of Physicians and Surgeons of Canada. EPAs and CanMEDs milestones. Available from URL: https://www.royalcollege.ca/ca/en/cbd/cbd-implementation/specialty-education-design/cbd-milestones-epas.html (accessed July 2023).

  10. Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies: guided by information power. Qual Health Res 2016; 26: 1753–60. https://doi.org/10.1177/1049732315617444

    Article  PubMed  Google Scholar 

  11. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006; 3: 77–101.

    Article  Google Scholar 

  12. Takahashi SG, Waddell A, Kennedy M, Hodges B. Innovations, integration and implementation issues in competency-based training in postgraduate medical education; 2011. Available from URL: https://web.archive.org/web/20180426133026id_/https://www.afmc.ca/pdf/fmec/19_Glover%20Takahashi_Competency-based%20Education.pdf (accessed July 2023).

  13. Frank JR, Snell LS, Cate OT, et al. Competency-based medical education: theory to practice. Med Teach 2010; 32: 638–45. https://doi.org/10.3109/0142159x.2010.501190

    Article  PubMed  Google Scholar 

  14. Ju JY, Wehrli G. The effect of entrustable professional activities on pathology resident confidence in blood banking/transfusion medicine. Transfusion 2020; 60: 912–7. https://doi.org/10.1111/trf.15679

    Article  PubMed  Google Scholar 

  15. Mann S, Truelove AH, Beesley T, Howden S, Egan R. Resident perceptions of competency-based medical education. Can Med Educ J 2020; 11: e31–43. https://doi.org/10.36834/cmej.67958

  16. Yoon CH, Myung SJ, Park WB. Implementing competency-based medical education in internal medicine residency training program: the process and impact on residents’ satisfaction. J Korean Med Sci 2019; 34: e201. https://doi.org/10.3346/jkms.2019.34.e201

    Article  PubMed  PubMed Central  Google Scholar 

  17. Cadieux M, Healy M, Petrusa E, et al. Implementation of competence by design in Canadian neurosurgery residency programs. Med Teach 2022; 44: 380–7. https://doi.org/10.1080/0142159x.2021.1994937

    Article  PubMed  Google Scholar 

  18. Mann KV. Theoretical perspectives in medical education: past experience and future possibilities. Med Educ 2011; 45: 60–8. https://doi.org/10.1111/j.1365-2923.2010.03757.x

    Article  PubMed  Google Scholar 

  19. Fraser SW, Greenhalgh T. Co** with complexity: educating for capability. BMJ 2001; 323: 799–803. https://doi.org/10.1136/bmj.323.7316.799

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Chung AD, Kwan BYM, Wagner N, et al. An adaptation-focused evaluation of Canada’s first competency-based medical education implementation in radiology. Eur J Radiol 2022; 147: 110109. https://doi.org/10.1016/j.ejrad.2021.110109

    Article  PubMed  Google Scholar 

  21. Blades ML, Glaze S, McQuillan SK. Resident perspectives on competency-by-design curriculum. J Obstet Gynaecol Can 2020; 42: 242–7. https://doi.org/10.1016/j.jogc.2019.07.005

    Article  PubMed  Google Scholar 

  22. Branfield Day L, Miles A, Ginsburg S, Melvin L. Resident perceptions of assessment and feedback in competency-based medical education: a focus group study of one internal medicine residency program. Acad Med 2020; 95: 1712–7. https://doi.org/10.1097/acm.0000000000003315

    Article  PubMed  Google Scholar 

  23. Crawford L, Cofie N, McEwen L, Dagnone D, Taylor SW. Perceptions and barriers to competency-based education in Canadian postgraduate medical education. J Eval Clin Pract 2020; 26: 1124–31. https://doi.org/10.1111/jep.13371

    Article  PubMed  Google Scholar 

  24. Brown A, Currie D, Mercia M, Mintz M, Fruetel K, Kassam A. Does the implementation of competency-based medical education impact the quality of narrative feedback? A retrospective analysis of assessment data in a Canadian internal medicine residency program. Can Journ Gen Int Med 2022; 17: 67–85. https://doi.org/10.22374/cjgim.v17i4.640

  25. Tomiak A, Linford G, McDonald M, Willms J, Hammad N. Implementation of competency-based medical education in a Canadian medical oncology training program: a first year retrospective review. J Cancer Educ 2022; 37: 852–6. https://doi.org/10.1007/s13187-020-01895-y

    Article  PubMed  Google Scholar 

  26. Royal College of Physicians and Surgeons of Canada, Resident Doctors of Canada. Is competence by design working? The role of program evaluation. Available from URL: https://www.royalcollege.ca/ca/en/cbd/understanding-cbd/cbd-program-evaluation.html (accessed July 2023).

  27. Fédération des médecins résidents du Québec. Year 3 of implementation of competence by design: negative impact still outweighs theoretical benefit; 2020. Available from URL: https://fmrq.qc.ca/wp-content/uploads/2022/07/fmrq-report-cbd-implementation-year-3_1.pdf (accessed July 2023).

  28. Hanley M, Shearer C, Livingston P. Faculty perspectives on the transition to competency-based medical education in anesthesia. Can J Anesth 2019; 66: 1320–7. https://doi.org/10.1007/s12630-019-01412-w

    Article  PubMed  Google Scholar 

  29. Gauthier S, Melvin L, Mylopoulos M, Abdullah N. Resident and attending perceptions of direct observation in internal medicine: a qualitative study. Med Educ 2018; 52: 1249–58. https://doi.org/10.1111/medu.13680

    Article  PubMed  Google Scholar 

  30. Rich JV, Young SF, Donnelly C, et al. Competency-based education calls for programmatic assessment: but what does this look like in practice? J Eval Clin Pract 2020; 26: 1087–95. https://doi.org/10.1111/jep.13328

    Article  PubMed  Google Scholar 

Download references

Author contributions

Franziska A. Miller contributed to study design, obtaining ethical approval, recruitment of participants, data collection, data analysis, and writing the manuscript. Sarah Wood contributed to project design, manuscript revisions, and project supervision. Patricia Livingston contributed to study design, obtaining ethical approval, data analysis, manuscript revisions, and project supervision.

Acknowledgements

The authors would like to acknowledge Gillian Scanlan for her input on the early study design.

Disclosures

This research was conducted to fulfill the dissertation requirements of the Master of Medical Education at the University of Dundee for Franziska Miller. The authors alone are responsible for the content and writing of this article.

Funding statement

This project was supported through the Killam Scholarship offered by the Faculty of Medicine at Dalhousie University, Halifax, NS, Canada.

Prior conference presentations

These findings have not been presented at a formal conference, but a presentation of findings was conducted at the Department of Anesthesia, Pain Management & Perioperative Medicine Research Day 2023 in fulfillment of the scholarly research project requirements in residency.

Editorial responsibility

This submission was handled by Dr. Stephan K. W. Schwarz, Editor-in-Chief, Canadian Journal of Anesthesia/Journal canadien d’anesthésie.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Franziska Miller MD.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (PDF 143 kb)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Miller, F., Wood, S. & Livingston, P. The lived experience of Competence by Design: Canadian resident physicians’ perspectives. Can J Anesth/J Can Anesth 71, 254–263 (2024). https://doi.org/10.1007/s12630-023-02678-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12630-023-02678-x

Keywords

Navigation