Video-based Coaching (VBC) in Gynecologic Surgery
Study Details
Study Description
Brief Summary
This multi-centre, randomized controlled trial aims to assess the role of video-based coaching (VBC) in residency education in gynecologic and gynecologic oncology surgery. It involves a trainee and a surgical coach, who together review a recording of the trainee performing a surgical skill or procedure and coaching is provided for skill improvement. Resident performance will be evaluated using a standardized scoring scale by two experienced surgeons before and after the intervention and compared to the control group receiving the standard surgical teaching curriculum.
| Condition or Disease | Intervention/Treatment | Phase |
|---|---|---|
|
N/A |
Detailed Description
Achieving technical excellence is a core component of surgical training. Historically, a combination of didactic teaching, surgical simulation and the master-apprentice model (MAM) were the cornerstone of surgical education. With restrictions on resident duty hours and operating time with the COVID-19 pandemic and a shift to competency-based medical education, there is an opportunity to transform surgical education and improve educational efficiency. The purpose of this study is to assess the effect of video-based coaching (VBC) on resident skill acquisition in laparoscopic suturing of the vaginal vault at the time of laparoscopic hysterectomy.
Participants will include year 3 to 5 Obstetrics and Gynecology residents completing gynecology and gynecologic oncology rotations at the study sites. Participants will be randomized to the control (standard surgical curriculum) and intervention (standard curriculum and VBC) arms on the day of the first attempt. The effectiveness of VBC will be measured by the difference in baseline and post-intervention standardized blinded score between the intervention and control group during laparoscopic closure of the vaginal cuff.
All residents will be video recorded performing laparoscopic closure of the vaginal cuff at the time of hysterectomy using video recording built into the laparoscopic equipment in the operating rooms. Residents in the control group will receive standard surgical teaching (MAM), then they will be video-recorded performing the skill at their second attempt. Residents in the intervention group will receive the standard surgical teaching plus the intervention of reviewing the recorded video with the surgical coach at the end of the procedure (MAM plus VBC). The surgical coach will provide specific personalized feedback on performance and suggestions for improvement following the Wisconsin Coaching Framework during their coaching session. Participants will then be recorded on their subsequent attempt.
All raw video footage will be edited to include only the relevant portion of the film. This will facilitate the assessment process (i.e., the assessors will view only the relevant footage). The edited video segments for both groups on both attempts will be scored independently using the validated surgical assessment tool by two blinded, experienced gynecologic laparoscopists to evaluate surgical performance (blinded to attempt number and randomization group). The average score between both assessors will be used for statistical analysis. The effectiveness of VBC will be evaluated by comparing the difference in assessment scores between the baseline and post-intervention scores between the control and intervention groups.
Study Design
Arms and Interventions
| Arm | Intervention/Treatment |
|---|---|
| Experimental: Video-based coaching Participants in the intervention arm will receive the standard surgical teaching while in the operating room (master-apprentice model (MAM)), plus the intervention of reviewing the recorded video with the surgical coach after performing their first attempt at laparoscopic closure of the vaginal vault. |
Other: Video-based coaching
The coaching session will follow the Wisconsin Coaching Framework (Greenberg 2015). The surgical coaching session will last at maximum 30 minutes and will occur within 1-2 week following the procedure. The surgical coaching session will occur over Zoom. The second attempt will occur within 1 week following the coaching session.
Other: Standard surgical teaching (master-apprentice model - (MAM))
Standard surgical teaching that conventionally occurs in the operating room follows a master-apprentice model (MAM).
|
| Placebo Comparator: Standard surgical teaching Participants in the control arm will receive the standard surgical teaching while in the operating room (master-apprentice model-(MAM)). |
Other: Standard surgical teaching (master-apprentice model - (MAM))
Standard surgical teaching that conventionally occurs in the operating room follows a master-apprentice model (MAM).
|
Outcome Measures
Primary Outcome Measures
- Mean change from baseline in modified-OSATS (Objective Structured Assessment of Technical Skill) score after video-based coaching intervention compared to control of standard surgical teaching [The first and second attempt will occur within a 1 month timeframe. The blinded assessors will complete the evaluation of the surgical videos for performance within 6 months of study completion.]
The modified OSATS score is a standardized rubric for assessing technical skills
Secondary Outcome Measures
- Participant assessment of desirability of video-based surgical coaching [Desirability will be calculated at the end of study enrolment within 1 year,]
Desirability of the intervention will be evaluated based on the proportion of eligible residents who enrol in the study (number enrolled/number eligible).
- Participant assessment of usefulness of video-based surgical coaching [Questionnaire to be completed by participant within 1 month of second attempt.]
Participants in the intervention arm will complete a surgical coachee questionnaire to determine if the participants in the intervention arm found the coaching experience to be useful for developing their surgical skills.
- Surgical coach assessment of feasibility of video-based surgical coaching [Questionnaire to be completed by surgical coach on day of coaching session and all questionnaires will be completed within 1 year.]
Surgical coach will complete a questionnaire immediately after the coaching activity, which will collect time for video-editing, time for coaching session and receptivity of the participant to coaching
- Inter-rater reliability of the video evaluations by the blinded, experienced laparoscopists [The blinded assessors will complete the evaluation of the surgical videos for performance within 6 months of study completion.]
The intraclass correlation coefficient (ICC) between the two score for each video will be calculated
Eligibility Criteria
Criteria
Inclusion Criteria:
-
Postgraduate year (PGY) 3 to 5 residents in the Obstetrics and Gynaecology program at the University of Toronto
-
Completing chief gynecology rotation at Mount Sinai Hospital (MSH) and Sunnybrook Health Sciences Centre (SHSC), and gynecologic oncology rotation at University Health Network (UHN) and SHSC form Sept 2021 until June 2022
Exclusion Criteria:
- Previous participation in study on another rotation
Contacts and Locations
Locations
| Site | City | State | Country | Postal Code | |
|---|---|---|---|---|---|
| 1 | Sunnybrook Health Sciences Centre | Toronto | Ontario | Canada | M4N 3M5 |
| 2 | Mount Sinai Hospital | Toronto | Ontario | Canada | M5G 1Z5 |
| 3 | University Health Network | Toronto | Ontario | Canada | M5G 1Z5 |
Sponsors and Collaborators
- Mount Sinai Hospital, Canada
- Sunnybrook Health Sciences Centre
- University Health Network, Toronto
Investigators
- Principal Investigator: Evan Tannenbaum, MD, MSc, MOUNT SINAI HOSPITAL
Study Documents (Full-Text)
None provided.More Information
Publications
None provided.- 3629