Log in

Evaluation of advanced laparoscopic skills tasks for validity evidence

  • Published:
Surgical Endoscopy Aims and scope Submit manuscript

Abstract

Background

Since fundamentals of laparoscopic surgery (FLS) represents a minimum proficiency standard for laparoscopic surgery, more advanced proficiency standards are required to address the needs of current surgical training. We wanted to evaluate the acceptance and discriminative ability of a novel set of skills building on the FLS model that could represent a more advanced proficiency standard—advanced laparoscopic surgery (ALS).

Methods

Qualitative and quantitative analyses were employed. Quantitative analysis involved comparison of expert (PGY 5+), intermediate (PGY 3–4) and novice (PGY 1–2) surgeons on FLS and ALS tasks. Composite scores included time and errors. Standard FLS errors were added to task time to create the composite score. Qualitative analysis involved thematic review of open-ended questions provided to experts participating in the study.

Results

Out of 48 participants, there were 15 (31 %) attendings, 3 (6 %) fellows and 30 (63 %) residents. By specialty, 54 % were general/MIS/bariatric/colorectal (GMBC) and 46 % were other (urology and gynecology). There was no difference between experience level and performance on FLS and ALS tasks for the entire cohort. However, looking at the GMBC subgroup, experts performed better than novices (p = 0.012) and intermediates performed better than novices (p = 0.057) on ALS tasks. There was no difference for the same group in FLS performance. Also, GMBC subgroup performed significantly better on FLS (p = 0.0035) and ALS (p = 0.0027) than the other subgroup. Thematic analysis revealed that the majority of experts felt that ALS was more realistic, challenging and clinically relevant for specific situations compared to FLS.

Conclusion

For GMBC surgeons, we were able to show evidence of validity for a series of advanced laparoscopic tasks and their relationship to surgeon skill level. This study may represent the first step in the development of an advanced laparoscopic skills curriculum. Given the high degree of specialization in surgery, different advanced skills curricula will need to be developed for each specialty.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Stain SC, Cogbill TH, Ellison CE, Brittt LD, Ricotta JJ, Calhoun JH, Baumgartner WA (2012) Surgical training models: a new vision. Curr Probl Surg 49:565–623

    Article  PubMed  Google Scholar 

  2. Bell RH (2009) Why Johnny cannot operate. Surgery 146:533–542

    Article  PubMed  Google Scholar 

  3. Bell RH Jr, Biester TW, Tabuenca AW, Rhodes RS, Cofer JB, Britt LD, Lewis FR (2009) Operative experience of residents in US general surgery programs: a gap between expectation and experience. Ann Surg 249:719–724

    Article  PubMed  Google Scholar 

  4. Yeo H, Viola K, Berg D, Lin Z, Nunez-Smith M, Cammann C, Bell RH, Sosa JA, Krumholz HM, Curry LA (2009) Attitudes, training experiences, and professional expectations of US general surgery residents: a national survey. JAMA 302(12):1301–1308

    Article  CAS  PubMed  Google Scholar 

  5. Fronza JS, Prystowsky JP, DaRosa D, Fryer J (2012) Surgical residents’ perception of competence and relevance of the clinical curriculum to future practice. J Surg Educ 69:792–797

    Article  PubMed  Google Scholar 

  6. ACGME data resource book—academic year 2011–2012. www.acgme.org

  7. The Fellowship council 2013 match results. https://fellowshipcouncil.org/

  8. NRMP fellowship match results 2013

  9. Mattar SG, Alseidi AA, Jones DB, Jeyarajah DR, Swanstrom LL, Aye RW, Wexner SD, Martinez JM, Ross SB, Awad MM, Franklin ME, Arregui ME, Schirmer BD, Minter RM (2013) General surgery residency inadequately prepares trainees for fellowship—results of a survey of fellowship program directors. Ann Surg 258:440–449

    Article  PubMed  Google Scholar 

  10. Fried GM, Derossis AM, Bothwell J, Sigman HH (1999) Comparison of laparoscopic performance in vivo with performance measured in laparoscopic simulator. Surg Endosc 13:1077–1081

    Article  CAS  PubMed  Google Scholar 

  11. Fried GM, Feldman LS, Vassiliou MC, Fraser SA, Standbridge D, Ghitulescu G, Andrew G (2004) Proving the value of simulation in laparoscopic surgery. Ann Surg 240:518–528

    Article  PubMed Central  PubMed  Google Scholar 

  12. Feldman LS, Sherman V, Fried GM (2004) Using simulators to assess laparoscopic competence: Ready for widespread use? Surgery 135:28–42

    Article  PubMed  Google Scholar 

  13. Fraser SA, Klassen DR, Feldman LS, Ghitulescu GA, Stanbridge D, Fried GM (2003) Evaluating laparoscopic skills. Surg Endosc 17:964–967

    Article  CAS  PubMed  Google Scholar 

  14. Hafford ML, Van Sickle KR, Willis RE, Wilson TD, Gugliuzza K, Brown KM et al (2013) Ensuring competency: Are fundamentals of laparoscopic surgery training and certification necessary for practicing surgeons and operating room personnel? Surg Endosc. doi:10.1007/s00464-012-24377

    PubMed  Google Scholar 

  15. Derevianko AY, Schwaitzberg SD, Tsuda S, Barrios L, Brooks C, Callery MP et al (2010) Malpractice carrier underwrites fundamentals of laparoscopic surgery training and testing: a benchmark for patient safety. Surg Endosc. doi:10.1007/s00464-009-0617-x

    PubMed  Google Scholar 

  16. Okrainec A, Soper NJ, Swanstrom LL, Fried GM (2011) Trends and results of the first 5 years of Fundamentals of Laparoscopic Surgery (FLS) certification testing. Surg Endosc 25:1192–1198

    Article  PubMed  Google Scholar 

  17. Ritter EM, Scott DJ (2007) Design of a proficiency based training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112

    Article  PubMed  Google Scholar 

  18. Swanstrom LL, Fried GM, Hoffman KI, Soper NJ (2006) Beta test results of a new system assessing competence in laparoscopic surgery. J Am Coll Surg 202:62–69

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

I would like to thank Dr. Woo** Lee for his inspirational idea that sparked this study. This study was funded by the Robert E. Wise Educational Research Grant.

Disclosures

Dmitry Nepomnayshy, James Whitledge, Richard Birkett, Theodore Delmonico, Robin Ruthazer, Lelan Sillin, Neal E. Seymour have no conflict of interest.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dmitry Nepomnayshy.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nepomnayshy, D., Whitledge, J., Birkett, R. et al. Evaluation of advanced laparoscopic skills tasks for validity evidence. Surg Endosc 29, 349–354 (2015). https://doi.org/10.1007/s00464-014-3674-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00464-014-3674-8

Keywords

Navigation