Applying Gamification to Postgraduate Endoscopic Training

Sponsor
Unity Health Toronto (Other)
Overall Status
Completed
CT.gov ID
NCT03176251
Collaborator
(none)
40
1
2
26.9
1.5

Study Details

Study Description

Brief Summary

Simulation-based training curricula for gastrointestinal endoscopy have been developed and have been shown to be effective. It is possible that these curricula may be further improved. Gamification, the application of game-design principles to non-game contexts, has been shown to improve learning and skill performance in medical education. In gastrointestinal endoscopy, however, no dedicated curricula have been developed using gamification principles. We aim to evaluate the impact of applying gamification to a curriculum using SBT in endoscopy on clinical performance, compared to an identical curriculum without gamification. 36 novice endoscopists from the general surgery and gastroenterology programs at the University of Toronto will be recruited. Participants will be randomized into two groups: the Conventional Training Curriculum (CTC) Group, in which participants will receive 6 hours of training on a simulator augmented with expert feedback and interlaced with 4 hours of didactic training on the theory of colonoscopy; and the Gamified Integrated Curriculum (GIC) Group, in which participants will receive the same curriculum, using the following applications of gamified learning: a leaderboard of participant performances; badges for achievement of training landmarks; and rewards for top performance. Participants will be trained to perform colonoscopies progressively moving from a low to high complexity simulators, starting with the bench-top model (1 hour) and then moving to the EndoVR® virtual reality (VR) gastroenterology simulator (5 hours). Performance will be assessed at three points: prior to training (pre-test), immediately after training (acquisition post-test) and 4-6 weeks after training (retention test). Assessment will take place on the simulator at all three time points and during two live colonoscopies at the retention test. The primary outcome measure will be the difference in clinical colonoscopy performance between the two training groups, as assessed by the Joint Advisory Group for GI Endoscopy Direct Observation of Procedural Skills (JAG/DOPS). We aim to have data collection finished by 2018. Our results have the potential to improve existing curricula for training in colonoscopy. Moreover, the development of a gamified curriculum in procedural skills may have applicability to other specialities, such as general surgery and anesthesiology.

Condition or Disease Intervention/Treatment Phase
  • Other: Gamified-Integrated Curriculum
N/A

Study Design

Study Type:
Interventional
Actual Enrollment :
40 participants
Allocation:
Randomized
Intervention Model:
Parallel Assignment
Intervention Model Description:
Randomized, two-arm, single-blindedRandomized, two-arm, single-blinded
Masking:
Double (Investigator, Outcomes Assessor)
Primary Purpose:
Other
Official Title:
Gamification of a Virtual-reality Simulation Curriculum in Endoscopy: Impact on Clinical Performance
Actual Study Start Date :
Jun 1, 2017
Actual Primary Completion Date :
Aug 30, 2019
Actual Study Completion Date :
Aug 30, 2019

Arms and Interventions

Arm Intervention/Treatment
Active Comparator: Control Group: Conventional Training Group

This group will receive 4 hours of didactic and hands-on sessions on colonoscopy theory and non-technical skills. Participants will also watch a video that demonstrates an ideal endoscopic procedure. After each didactic session, a short multiple-choice questionnaire based on the topics covered in that session will be administered. In addition to didactic training, the control group will be given six hours of expert-assisted instruction on low-fidelity (1 hour) and high-fidelity (5 hours) colonoscopy simulators. Six modules of increasing difficulty in colonoscopy will be taught using one-on-one feedback from an expert academic endoscopist. The endoscopy instructor will demonstrate techniques and provide feedback. During training on the high-fidelity simulator, the last two hours will take the form of the integrated scenario, which will feature a standardized patient (SP) and standardized nurse (SN). Feedback will be given after each integrated scenario by the instructor.

Other: Gamified-Integrated Curriculum
The experimental group will receive identical training compared to the control group, with the additional incorporation of several elements of gamification, as outlined in the Arm/Group descriptions.

Experimental: Intervention Group: Gamified-Integrated Curriculum (GIC)

The intervention group will receive the same core training as the control group with additional elements of gamification: leaderboards and badges. First, leaderboards will be used to track and rank participants' performances. This will be done through an anonymized ID tag that allows a participant to identify only their position on the leaderboard. This leaderboard will include 4 components: non-technical skills, technical skills, cognitive skills, and overall ranking. Scores will be aggregated only from participants training on the same days. The leaderboard will be displayed on a central laptop and/or TV screen and will be accessible at any time throughout the day. Second, participants in the GIC group will have the opportunity to be rewarded for their performances using achievement badges which are visual cues to the player that he or she has achieved something. Awards will be given to participants at the top of the leaderboard and with the most badges.

Other: Gamified-Integrated Curriculum
The experimental group will receive identical training compared to the control group, with the additional incorporation of several elements of gamification, as outlined in the Arm/Group descriptions.

Outcome Measures

Primary Outcome Measures

  1. Performance on a clinical colonoscopy [4-6 weeks post-intervention]

    Difference between the control and intervention groups during two clinical colonoscopies as assessed by two independent, blinded, expert endoscopists using the Joint Advisory Group for GI Endoscopy Direct Observation of Procedural Skills (JAG/DOPS)

Secondary Outcome Measures

  1. Procedural Knowledge [Pre-intervention and immediate post-intervention]

    Differences between the two groups with respect to procedural knowledge as assessed by multiple-choice questionnaires

  2. Non-technical performance [4-6 weeks post-intervention]

    Differences between the two groups with respect to non-technical performance during clinical colonoscopies and an integrated scenario format test 4-6 weeks after training, as assessed by the modified objective structured assessment of nontechnical skills (M-OSANTS)

  3. Patient comfort [4-6 weeks post-intervention]

    Differences between the two groups with respect to patient comfort during the clinical colonoscopies, as assessed by the Nurse-Assessed Patient Comfort Score (NAPCOMS)

  4. Participant self-efficacy [Pre-intervention, immediate post-intervention, and 4-6 weeks post-intervention]

    Differences between the two groups with respect to participant self-efficacy, as measured by an adapted scale based on the General Self-Efficacy Scale

  5. Cognitive load [Pre-intervention, immediate post-intervention, and 4-6 weeks post-intervention]

    Differences between the two groups with respect to cognitive load, as measured by the Cognitive Load Scale for Colonoscopy

  6. Technical performance [Immediate post-intervention and 4-6 weeks post-intervention]

    Difference between the two groups with respect to technical performance on a VR simulated colonoscopies as assessed through the JAG/DOPS

  7. Participant competitiveness [Pre-intervention]

    Difference between the two groups with respect to competitiveness as measured using the Revised Competitiveness Index

Eligibility Criteria

Criteria

Ages Eligible for Study:
N/A and Older
Sexes Eligible for Study:
All
Accepts Healthy Volunteers:
Yes
Inclusion Criteria:
  • Participants must be novice endoscopists enrolled in general surgery, adult gastroenterology and pediatric gastroenterology programs at the University of Toronto
Exclusion Criteria:
  • Participants will be excluded if they have performed 25 or more real or simulated endoscopic procedures

Contacts and Locations

Locations

Site City State Country Postal Code
1 St. Michael's Hospital Toronto Ontario Canada M5B 1W8

Sponsors and Collaborators

  • Unity Health Toronto

Investigators

None specified.

Study Documents (Full-Text)

None provided.

More Information

Publications

None provided.
Responsible Party:
Samir Grover, Dr. Samir C. Grover, MD, MEd, FRCPC, Unity Health Toronto
ClinicalTrials.gov Identifier:
NCT03176251
Other Study ID Numbers:
  • 17-092
First Posted:
Jun 5, 2017
Last Update Posted:
Jan 14, 2021
Last Verified:
Jan 1, 2021
Individual Participant Data (IPD) Sharing Statement:
No
Plan to Share IPD:
No
Studies a U.S. FDA-regulated Drug Product:
No
Studies a U.S. FDA-regulated Device Product:
No

Study Results

No Results Posted as of Jan 14, 2021