ArticlePDF Available

Remote and asynchronous training network: from a SAGES grant to an eight-country remote laparoscopic simulation training program

Authors:

Abstract and Figures

Background Limitations in surgical simulation training include lack of access to validated training programs with continuous year-round training and lack of experts’ ongoing availability for feedback. A model of simulation training was developed to address these limitations. It incorporated basic and advanced laparoscopic skills curricula from a previously validated program and provided instruction through a digital platform. The platform allowed for remote and asynchronous feedback from a few trained instructors. The instructors were continuously available and provided personalized feedback using a variety of different media. We describe the upscaling of this model to teach trainees at fourteen centers in eight countries. Methods Institutions with surgical programs lacking robust simulation curricula and needing instructors for ongoing education were identified. The simulation centers (“skills labs”) at these sites were equipped with necessary simulation training hardware. A remote training-the-administrators (TTA) program was developed where personnel were trained in how to manage the skills lab, schedule trainees, set up training stations, and use the platform. A train-the-trainers (TTT) program was created to establish a network of trained instructors, who provided objective feedback through the platform remotely and asynchronously. Results Between 2019 and 2022, seven institutions in Chile and one in each of the USA, Bolivia, Brazil, Ecuador, El Salvador, México, and Perú implemented a digital platform-based remote simulation curriculum. Most administrators were not physicians (19/33). Eight Instructors were trained with the TTT program and became active proctors. The platform has been used by 369 learners, of whom 57% were general surgeons and general surgery residents. A total of 6729 videos, 28,711 feedback inputs, and 233.7 and 510.2 training hours in the basic and advanced programs, respectively, were registered. Conclusion A remote and asynchronous method of giving instruction and feedback through a digital platform has been effectively employed in the creation of a robust network of continuous year-round simulation-based training in laparoscopy. Training centers were successfully run only with trained administrators to assist in logistics and setup, and no on-site instructors were necessary.
This content is subject to copyright. Terms and conditions apply.
Vol.:(0123456789)
1 3
Surgical Endoscopy
https://doi.org/10.1007/s00464-022-09386-5
2022 SAGES ORAL
Remote andasynchronous training network: fromaSAGES grant
toaneight‑country remote laparoscopic simulation training program
MaríaInésGaete1· FranciscaBelmar1· MatíasCortés1· AdnanAlseidi2· DomenechAsbun3· ValentinaDurán1·
GabrielEscalona1· PabloAchurra1· IgnacioVillagrán1· FernandoCrovari1· FernandoPimentel1· JuliánVaras1
Received: 21 March 2022 / Accepted: 6 June 2022
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022
Abstract
Background Limitations in surgical simulation training include lack of access to validated training programs with continuous
year-round training and lack of experts’ ongoing availability for feedback. A model of simulation training was developed
to address these limitations. It incorporated basic and advanced laparoscopic skills curricula from a previously validated
program and provided instruction through a digital platform. The platform allowed for remote and asynchronous feedback
from a few trained instructors. The instructors were continuously available and provided personalized feedback using a
variety of different media. We describe the upscaling of this model to teach trainees at fourteen centers in eight countries.
Methods Institutions with surgical programs lacking robust simulation curricula and needing instructors for ongoing educa-
tion were identified. The simulation centers (“skills labs”) at these sites were equipped with necessary simulation training
hardware. A remote training-the-administrators (TTA) program was developed where personnel were trained in how to
manage the skills lab, schedule trainees, set up training stations, and use the platform. A train-the-trainers (TTT) program
was created to establish a network of trained instructors, who provided objective feedback through the platform remotely
and asynchronously.
Results Between 2019 and 2022, seven institutions in Chile and one in each of the USA, Bolivia, Brazil, Ecuador, El Salva-
dor, México, and Perú implemented a digital platform-based remote simulation curriculum. Most administrators were not
physicians (19/33). Eight Instructors were trained with the TTT program and became active proctors. The platform has been
used by 369 learners, of whom 57% were general surgeons and general surgery residents. A total of 6729 videos, 28,711
feedback inputs, and 233.7 and 510.2 training hours in the basic and advanced programs, respectively, were registered.
Conclusion A remote and asynchronous method of giving instruction and feedback through a digital platform has been
effectively employed in the creation of a robust network of continuous year-round simulation-based training in laparoscopy.
Training centers were successfully run only with trained administrators to assist in logistics and setup, and no on-site instruc-
tors were necessary.
Keywords Laparoscopic simulation· Simulation training· Remote feedback· Asynchronous feedback· Training network
Laparoscopic surgical skills are a critical part of many sur-
geons’ armamentarium [16]. However, the acquisition of
laparoscopic skills presents a specific and protracted learn-
ing curve compared to open surgery [712]. Residents’
ability to master laparoscopic skills during their training is
limited by many factors, including the reduction of working
hours, low incidence of certain diseases in some centers,
patient safety policies that limit resident autonomy, among
others. These constraints require exploring other learn-
ing methods. In this context, surgical simulation training
emerges as a complementary tool for the attainment of surgi-
cal skills. Simulation training reduces learning curves in a
and Other Interventional Te
chniques
* Julián Varas
jevaras@uc.cl
1 Experimental Surgery andSimulation Center, Department
ofDigestive Surgery, Catholic University ofChile,
Marcoleta 377, 2nd floor, ZipCode:8330024Santiago,
Chile
2 Department ofSurgery, University ofCalifornia,
SanFrancisco, USA
3 Hepatobiliary & Pancreatic Surgery, Miami Cancer Institute,
Miami, USA
Surgical Endoscopy
1 3
controlled and safe environment without putting the patient
at risk and transferring successfully the skills to the operat-
ing room [7, 13, 14].
In spite of this, surgical simulation training often has
significant limitations. These include restricted access to
validated training programs that provide deliberate practice
on an ongoing, year-round basis, as well as a lack of continu-
ous expert feedback. Availability of expert feedback is often
constrained by the expert’s busy schedule, lack of formal
training in teaching/evaluation or inability to be physically
present during training sessions. These impediments are
common and often result in a limited number of in-person
sessions given with a maximum of students per instructor,
who are restricted to their geographical locations [1517].
In 2019, thanks to the support of a SAGES research grant,
a web-based and mobile iOS and Android digital platform
(“LAPP”) was developed with the goal of overcoming these
limitations. The platform was designed to train general sur-
gery residents and surgeons remotely and asynchronously
in basic and/or advanced laparoscopic skills using simula-
tion training. It uses a network of trained instructors, who
remotely review practice by enrolled trainees, providing
objective multimedia feedback (texts, audios, drawings, and/
or videos) within 72h [7]. The use of this digital method-
ology was successfully validated as a tool at least as good
as in-person training, showing that surgeons can be trained
remotely and asynchronously [7].
Remote training through the digital platform was initially
established at two training centers. Given successful proof-
of-concept (as above), the program was further expanded to
include multiple training centers across different countries.
We describe our experience of scaling the use of remote
and asynchronous feedback through the platform to fourteen
training centers across eight countries.
Methods
How Institutions were selected
Institutions whose surgical training programs lacked a robust
simulation curriculum and did not have ongoing availabil-
ity of instructors for continuous coaching were identified.
Particular attention was given to locations that performed
a low number of advanced laparoscopic procedures, which
increases the potential for a training program to have a sub-
stantial impact on surgical education and the clinical use of
laparoscopy.
Development ofnew laparoscopic skills labs:
thethree‑pillar framework
Once the institutions were selected, the necessary adjust-
ments were made for the setup of a laparoscopic skills lab
in each location, using and modifying the infrastructures
that already existed in the institutions. A three-pillar frame-
work developed at our institution for the implementation
of any surgical simulation program was applied to success-
fully implement the remote training programs. They are as
follows: (1) Infrastructure (Hardware, training facilities,
administrative human resources, etc.), (2) validated surgi-
cal simulation training program (instructional design and
content, learning objectives, objective feedback, etc.). (3)
Trainers (an expert instructor network for instruction and
feedback) [7, 1820].
Infrastructure: whereandwhat supplies are required
totrain
Each institution was equipped with the same infrastructure
needed for the implementation of the laparoscopic simula-
tion training programs. This included ample training space
and supplies, such as laparoscopic training boxes, energy
devices, high-definition video recorders, accessory supplies,
among others. Figure1 shows the hardware accessories
needed for the basic training program. Then, a training-the-
administrators (TTA) remote program was developed to train
each administrator and/or faculty involved in the simula-
tion curriculum. These administrators are not involved in
teaching the surgical trainees, but instead assist with local
logistical issues. Four remote, live training sessions were
held during the TTA program, complemented with thirty
asynchronous instructional videos. These videos included
instructions on how to organize training at the skills lab,
manage trainees’ practice schedules, set up training stations,
record/upload videos, as well as general troubleshooting. A
technical and educational support structure was developed
to assist with any questions local administrators may have by
providing around-the-clock availability through the platform
or via email. Finally, an exam was given to each local admin-
istrator involved in the digital platform training site to ensure
that the necessary knowledge was acquired to successfully
run the curriculum at a local level.
Validated surgical simulation training programs: what
todowiththe hardware
The training program consisted of basic and advanced
laparoscopic skills courses, which had been previously
developed and validated [14, 19, 2125]. The basic skills
Surgical Endoscopy
1 3
course was composed of eleven exercises divided into two
groups whose complexity increases with each exercise and
group. Examples of these exercises include beans drop,
blocks movement, cannulation of a catheter into a train-
ing model, and interrupted intracorporeal sutures. The
advanced course consisted of performing a laparoscopic
hand-sewn jejunojejunostomy using an exvivo simulation
model with bovine intestine. Each of these courses is made
up of individual training modules that is successively build
on acquired skills. Assessments were established for each
module, being standardized with an objective grading scale
(objective structured assessment of technical skill, OSATS,
and specific rating scale, SRS), and focused on technical
details and time goals for each session. Further details of
the advanced laparoscopic training program are described
elsewhere [7, 14, 25].
Trainers: creation ofanexpert instructor network
A train-the-trainers (TTT) program was created with the
purpose of establishing a network of trained instructors who
could evaluate trainees remotely. Their purpose is to provide
objective multimedia feedback to trainees through the plat-
form remotely and asynchronously using personal digital
inputs [19]. Each instructor in training had to complete both
basic and advanced laparoscopic simulation courses. Then,
they completed four online courses on medical education.
They also received over fifteen tutorial videos on how to use
and navigate the platform, common errors made by trainees,
and sample videos showing an expert evaluating a student
through the platform. Then, each instructor in the TTT pro-
gram had to evaluate twenty videos of trainees undertaking
the laparoscopic simulation courses. The evaluations sought
to identify and categorize different types of errors, meas-
ure time to complete each exercise, and calculate an overall
score based on objective grading scales (OSATS & SRS).
Scores from these evaluations were compared to the average
scores of two expert evaluators in the same exercise. Once
the instructors started evaluating real trainees, they were ran-
domly supervised by experts throughout the year to maintain
a high level of inter-rater reliability.
The learning cycle: using adigital platform
duringsimulation training sessions
Once the above three pillars were established, surgical train-
ees were enrolled in the laparoscopic simulation training
programs. Trainees were general surgery, obstetrics and
gynecology, and urology professionals and residents with
interest in acquiring or improving their laparoscopic skills.
Trainees underwent basic and/or advanced laparoscopic
simulation training sessions through the platform in four
sequential steps (Fig.2):
(1) Trainees watch instructional videos on the digital plat-
form. These videos provide basic information on how
to perform each skill within the exercises that comprise
the simulation courses.
(2) They then perform unsupervised practice and upload
the videos of their corresponding training session to
Fig. 1 Hardware accessories needed for the basic training program
Surgical Endoscopy
1 3
the platform (with help from the local administrator at
their center).
(3) A remote trained instructor is assigned to the trainee
and gets notified of the new video upload by the plat-
form. The instructor uses the platform to assess the
recording, providing objective multimedia feedback
including texts, audio recordings, drawings annotat-
ing the trainee’s video, and/or short videos from a
library of example errors and corrections—these last
ones characterized by a duration of fewer than 30s to
show the correct technique for a specific exercise. The
instructors also provide an objective assessment based
on the aforementioned grading scales [13, 25, 26].
(4) The above-personalized feedback is finalized and sent
back to the trainee within seventy-two hours, incorpo-
rating it into ongoing training.
Further details of the digital platform are described else-
where [7].
Data collection
The digital platform database was used to collect data
regarding the total number of students enrolled, the passing
rate for each course, the number of videos uploaded, the
total amount and format of provided multimedia feedback
inputs (video, audio recording, drawing, and short videos),
among others.
Results
Between April 2019 and March 2022, a total of 14 institu-
tions successfully implemented a remote simulation training
curriculum, with seven institutions in Chile and one in each
of the USA, Bolivia, Brazil, Ecuador, El Salvador, México,
and Perú. Most of the administrators trained by the TTA
program involved in laparoscopic simulation skills labs are
not physicians (19/33), but technicians who are familiar
with basic computing. A total of 8 instructors were trained
through the program. All of them had previously completed
the program as trainees. The instructors’ profession is listed
in Table1.
The platform was used by 369 trainees, 29% of them
completed the basic laparoscopic training program, and 13%
completed the advanced laparoscopic training program. The
remaining trainees were still undergoing the course at the
Fig. 2 Sequential steps to be followed for remote and asynchronous learning using a digital platform
Table 1 Instructors’ profession
Instructor profession No of
instruc-
tors
Veterinarian 3
Research fellow 2
General surgery resident 2
General surgeon 1
Surgical Endoscopy
1 3
time of this publication. So far, we have no dropouts, and
from the trainees that have completed the basic program, 2
trainees have not passed the course. Fifty-seven percent were
general surgeons/surgery residents, 14% were obstetrics and
gynecologist specialists/residents, 3% were urologists/urol-
ogy residents, and 26% were from other specialties. A total
of 6,729 videos were uploaded, receiving 28,711 feedback
inputs. Fifty-six percent of the feedback inputs were texts,
3% audio messages, 15% drawings, and 26% were videos
(Fig.3).
Discussion
The implementation of this unprecedented training network
distributed in fourteen training centers across eight coun-
tries was not without difficulties. The most pronounced
of these was formulating a system to standardize training
across all centers at an administrative and teaching level.
This standardization had to include equivalent quality of
equipment, training curriculum, local logistical support, and
remote feedback given by qualified trainers. Thus, the train-
ing centers were established in a stepwise fashion: first, the
required supplies and material had to be in place. Only after
this setup was confirmed were the TTA and TTT programs
implemented. The TTA program standardized the local sup-
port given to students, to avoid logistical issues interfering
with the quality of training and instruction. The TTT pro-
gram standardized the quality and objectivity of feedback
and training given by the instructors to the trainees. Several
cultural and language barriers (Spanish, English, and Por-
tuguese) had to be overcome, being necessary to translate
and iterate the system through real users to provide the best
learning experience to trainees.
The remote and asynchronous laparoscopic simulation
training programs and the platform training network allowed
to train 369 students of different countries and surgical spe-
cialties. This last fact demonstrates that, despite being a
program mainly aimed at general surgery residents and sur-
geons, professionals of other surgical specialties also sought
to acquire or improve their laparoscopic technical skills. To
date, the center with the highest number of trainees enrolled
was the one located in a rural area in the south of Chile,
Temuco. This is attributable to that center being one of the
first centers recruited, and also may reflect a lack of other
opportunities in the area to undergo targeted laparoscopic
skills training. On the other hand, the institution with the
lowest number of trainees enrolled was the one located in
Mexico City, Mexico. This is probably due to the fact that
this center is one of the last institutions added to the network.
Fig. 3 Results of using the digital platform training network during 2019–2022
Surgical Endoscopy
1 3
Thanks to this digital platform methodology, it is feasi-
ble to have an average of 46 trainees per instructor a year,
obtaining promising results in-terms of scaling worldwide
and without the need to travel to remote places to learn or
teach laparoscopic skills.
To date, 29% of the trainees have completed the basic
skills course, whereas 13% completed the advanced course.
There have been no dropouts. This skew towards the basic
course may be because most centers have been active for less
than a year, making it hard for trainees to have completed
both courses. Additionally, the advanced program targeted
a smaller, more focused audience: practicing surgeons or
senior residents with baseline laparoscopic skills already.
It may likewise also reflect a greater population’s need for
basic skills to start.
Regarding feedback, an average of 4.3 inputs per video
was calculated. Text and common errors videos were the
feedback type preferred by instructors. The ease of writing
text and the ubiquity of text-centered commenting in social
media may explain this trend. At the same time, error vid-
eos were the second most common modality used, which
speaks of the utility of having specific examples available
to communicate a point. However, a more detailed analysis
is beyond the objectives of this project.
Multiple studies support the importance of all three pil-
lars used to expand this program [15, 27, 28]. However, the
authors see the cornerstone of success in this remote and
asynchronous training program to be the effective and per-
sonalized feedback given to students on an ongoing basis.
This pillar was feasible thanks to the TTT program, which
further expanded Quezada’s etal. “MITO” project [7], build-
ing a network of capable instructors to deliver the feedback.
These instructors were not necessarily practicing surgeons,
nor were they geographically near the trainees. The net-
work offers a realistic solution to the shortcomings of many
current simulation programs. It increases accessibility to
validated simulation training and provides a framework for
upscaling the program. This is of heightened importance
in places where laparoscopic surgical capacity is not fully
developed, nor are simulation training programs. Indeed, the
applications of this system may have positive implications
for any place with a constraint on expert time/availability,
which continues to be common in surgical communities
worldwide [2, 15, 27, 29].
To our knowledge, this is the first example of successful
remote simulation training using a combination of factors
not previously seen all together: instruction of a validated
program, remote and asynchronous multimedia feedback,
upscaling the program to multiple different countries, cul-
tures, and languages, and all instruction/feedback given
through a digital platform. There are multiple reports of
other tele-simulation projects, however, these have the limi-
tation of needing simultaneous availability of the trainee
and the instructor [2, 15, 29, 30]. It is also important to note
that both basic and advanced laparoscopic skills were taught
remotely, which is a novel achievement compared to most
other examples [2, 15, 29].
Only short-term outcomes are available, which neces-
sitates further studies to evaluate long-term outcomes of
the described methodology. In addition, an analysis of cost-
effectiveness related to implementation of this program
across multiple countries is warranted, which will aid in
overall assessment of sustainability.
Conclusion
A digital platform-based approach to simulation has been
successfully used in the creation of a robust multicultural
network of continuous, year-round laparoscopic training.
Training centers were successfully established with admin-
istrators to assist in setup, and no other on-site staff were
necessary. The approach may be used to further expand
simulation training without the constraints of traditional in-
person feedback from trainers by allowing distant unsuper-
vised practice with remote asynchronous feedback.
Acknowledgements This project would not have been possible with-
out the unwavering support of the Pontificia Universidad Católica de
Chiles’ Simulation team and the Department of Digestive Surgery:
Marcia Corvetto, Elga Zamorano, Valeria Alvarado, Eduardo Machuca,
Carlos Martinez, Francisco Serrano, Andres Campos, Raúl Nalvae,
Margarita Zapata, Fernando Crovari, Luis Ibañez, and Fernando
Pimentel. We also want to thank the programmer team led by Brian
del Alcazar, Marcelo Vargas, Ricardo Leiva, and Gabriel Ulloa.
Funding This study was funded and supported by SAGES Research
Grant 2017–2018, Chilean Research Grant FONDECYT No. 1100436
from CONICYT, and Chilean Research Grant code number 20CYE-
139772 from CORFO.
Declarations
Disclosures Julian Varas is the Founder of Training Competence, an
official spinoff startup from the Pontificia Universidad Católica de
Chile. Gabriel Escalona is the chief product manager of this startup.
María Inés Gaete, Francisca Belmar, and Ignacio Villagrán are consult-
ants of this startup. Training Competence and the Pontificia Univer-
sidad Católica de Chile are the owners of the rights and distribution
of the LAPP platform used for the assessment in this study. Pablo
Achurra, Fernando Crovari, Fernando Pimentel, Matías Cortés, Val-
entina Durán, Adnan Alseidi, and Domenech Asbun have no conflicts
of interest or financial ties to disclose.
References
1. Alaker M, Wynn GR, Arulampalam T (2016) Virtual reality train-
ing in laparoscopic surgery: a systematic review & meta-analysis.
Surgical Endoscopy
1 3
Int J Surg (London, England) 29:85–94. https:// doi. org/ 10. 1016/j.
ijsu. 2016. 03. 034
2. Okrainec A, Henao O, Azzie G (2010) Telesimulation: an effective
method for teaching the fundamentals of laparoscopic surgery in
resource-restricted countries. Surg Endosc 24(2):417–422. https://
doi. org/ 10. 1007/ s00464- 009- 0572-6
3. Vergis A, Steigerwald S (2018) Skill acquisition, assessment, and
simulation in minimal access surgery: an evolution of technical
training in surgery. Cureus 10(7):e2969. https:// doi. org/ 10. 7759/
cureus. 2969
4. Ejaz A, Sachs T, He J, Spolverato G, Hirose K, Ahuja N, Wolf-
gang CL, Makary MA, Weiss M, Pawlik TM (2014) A comparison
of open and minimally invasive surgery for hepatic and pancre-
atic resections using the Nationwide Inpatient Sample. Surgery
156(3):538–547. https:// doi. org/ 10. 1016/j. surg. 2014. 03. 046
5. Siddaiah-Subramanya M, Tiang K, Nyandowe M (2017) A new
era of minimally invasive surgery: progress and development of
major technical innovations in general surgery over the last dec-
ade. Surgery journal (New York, N.Y.) 3(4):e163–e166. https://
doi. org/ 10. 1055/s- 0037- 16086 51
6. Shah S, Aydin A, Fisher R, Ahmed K, Froghi S, Dasgupta P
(2022) Current status of simulation-based training tools in general
surgery: a systematic review. Int J Surg Open 38:100427. https://
doi. org/ 10. 1016/j. ijso. 2021. 100427
7. Quezada J, Achurra P, Jarry C, Asbun D, Tejos R, Inzunza M,
Ulloa G, Neyem A, Martínez C, Marino C, Escalona G, Varas J
(2020) Minimally invasive tele-mentoring opportunity-the mito
project. Surg Endosc 34(6):2585–2592. https:// doi. org/ 10. 1007/
s00464- 019- 07024-1
8. Lesch H, Johnson E, Peters J, Cendán JC (2020) VR simulation
leads to enhanced procedural confidence for surgical trainees. J
Surg Educ 77(1):213–218. https:// doi. org/ 10. 1016/j. jsurg. 2019.
08. 008
9. Higgins M, Madan C, Patel R (2021) Development and decay of
procedural skills in surgery: a systematic review of the effective-
ness of simulation-based medical education interventions. Surg
19(4):e67–e77. https:// doi. org/ 10. 1016/j. surge. 2020. 07. 013
10. Heskin L, Simms C, Holland J, Traynor O, Galvin R (2019) A
systematic review of the educational effectiveness of simulation
used in open surgery. Simul Healthcare 14(1):51–58. https:// doi.
org/ 10. 1097/ SIH. 00000 00000 000349
11. Mattar SG, Alseidi AA, Jones DB, Jeyarajah DR, Swanstrom LL,
Aye RW, Wexner SD, Martinez JM, Ross SB, Awad MM, Frank-
lin ME, Arregui ME, Schirmer BD, Minter RM (2013) General
surgery residency inadequately prepares trainees for fellowship:
results of a survey of fellowship program directors. Ann Surg
258(3):440–449. https:// doi. org/ 10. 1097/ SLA. 0b013 e3182 a191ca
12. Academia Chilena de Medicina (2009) Situación actual de la Edu-
cación Médica en Chile. Rev Med Chil 137(5):709–712. https://
doi. org/ 10. 4067/ S0034- 98872 00900 05000 17
13. León Ferrufino F, Varas Cohen J, Buckel Schaffner E, Crovari
Eulufi F, Pimentel Müller F, Castillo M, Jarufe Cassis N, Boza
Wilson C (2015) Simulation in laparoscopic surgery. Cir Esp
93(1):4–11. https:// doi. org/ 10. 1016/j. ciresp. 2014. 02. 011
14. Boza C, León F, Buckel E, Riquelme A, Crovari F, Martínez J,
Aggarwal R, Grantcharov T, Jarufe N, Varas J (2017) Simulation-
trained junior residents perform better than general surgeons on
advanced laparoscopic cases. Surg Endosc 31(1):135–141. https://
doi. org/ 10. 1007/ s00464- 016- 4942-6
15. Mizota T, Kurashima Y, Poudel S, Watanabe Y, Shichinohe T,
Hirano S (2018) Step-by-step training in basic laparoscopic skills
using two-way web conferencing software for remote coaching: a
multicenter randomized controlled study. Am J Surg 216(1):88–
92. https:// doi. org/ 10. 1016/j. amjsu rg. 2017. 12. 008
16. Cifuentes IJ, Dagnino BL, Pérez ME, Yañez RA, Varas J, Salis-
bury C (2018) Entrenamiento microquirúrgico a distancia. Cir Plat
Iberoame 44:7. https:// doi. org/ 10. 4321/ S0376- 78922 01800 04000
09
17. Rojas-Muñoz E, Cabrera ME, Lin C, Andersen D, Popescu V,
Anderson K, Zarzaur BL, Mullis B, Wachs JP (2020) The sys-
tem for telementoring with augmented reality (STAR): a head-
mounted display to improve surgical coaching and confidence in
remote areas. Surgery 167(4):724–731. https:// doi. org/ 10. 1016/j.
surg. 2019. 11. 008
18. Vela J, Contreras C, Jarry C, Varas J, Corvetto M (2020) Reco-
mendaciones generales para elaborar un programa de entrenami-
ento basado en simulación para desarrollar competencias en pre-
grado y postgrado. Rev Latinoam Simul Clín 2(1):26–38. https://
doi. org/ 10. 35366/ 92936
19. Jarry C, Inzunza M, Quezada J, Marino C, Zamorano E, Alvarado
V, Martinez C, Machuca E, Achurra P, Varas J (2019) Gimnasio
de simulación quirúrgica: una herramienta educacional factible de
entrenamiento continuo. Experiencia de un centro universitario.
Rev Latinoam Simul Clín 1(1):18–24. https:// doi. org/ 10. 35366/
RSC19 1D
20. Morrison JE, Hammon C (2000). On Measuring the Effective-
ness of Large-Scale Training Simulations [Internet]. Institute for
Defense Analyses Alexandria Va. https:// apps. dtic. mil/ sti/ citat
ions/ ADA39 4491. Accessed 4 Mar 2022
21. Scott DJ, Ritter EM, Tesfay ST, Pimentel EA, Nagji A, Fried GM
(2008) Certification pass rate of 100% for fundamentals of laparo-
scopic surgery skills after proficiency-based training. Surg Endosc
22(8):1887–1893. https:// doi. org/ 10. 1007/ s00464- 008- 9745-y
22. Alkanhal A (2018) Fundamentals of laparoscopic surgery: princi-
ples, implementation, and comparison to other modalities. J Nat
Sci Med 1:2. https:// doi. org/ 10. 4103/ JNSM. JNSM_ 14_ 18
23. Fried GM, Feldman LS, Vassiliou MC, Fraser SA, Stanbridge D,
Ghitulescu G, Andrew CG (2004) Proving the value of simulation
in laparoscopic surgery. Ann Surg 240(3):518–528. https:// doi.
org/ 10. 1097/ 01. sla. 00001 36941. 46529. 56
24. Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF,
Schirmer B, Hoffman K, Committee SAGESFLS (2004) Devel-
opment and validation of a comprehensive program of education
and assessment of the basic fundamentals of laparoscopic surgery.
Surgery 135(1):21–27. https:// doi. org/ 10. 1016/ s0039- 6060(03)
00156-9
25. Varas J, Mejía R, Riquelme A, Maluenda F, Buckel E, Salinas
J, Martínez J, Aggarwal R, Jarufe N, Boza C (2012) Significant
transfer of surgical skills obtained with an advanced laparoscopic
training program to a laparoscopic jejunojejunostomy in a live
porcine model: feasibility of learning advanced laparoscopy in
a general surgery residency. Surg Endosc 26(12):3486–3494.
https:// doi. org/ 10. 1007/ s00464- 012- 2391-4
26. Martin JA, Regehr G, Reznick R, Macrae H, Murnaghan J, Hutch-
ison C, Brown M (1997) Objective structured assessment of tech-
nical skill (OSATS) for surgical residents. Br J Surg 84(2):273–
278. https:// doi. org/ 10. 1046/j. 1365- 2168. 1997. 02502.x
27. Vera M, Kattan E, Cerda T, Niklitshek J, Montaña R, Varas J,
Corvetto MA (2021) Implementation of distance-based simulation
training programs for healthcare professionals: breaking barriers
during COVID-19 pandemic. Simul Healthcare 16(6):401–406.
https:// doi. org/ 10. 1097/ SIH. 00000 00000 000550
28. Tejos R, Crovari F, Achurra P, Avila R, Inzunza M, Jarry C,
Martinez J, Riquelme A, Alseidi A, Varas J (2021) Video-based
guided simulation without peer or expert feedback is not enough: a
randomized controlled trial of simulation-based training for medi-
cal students. World J Surg 45(1):57–65. https:// doi. org/ 10. 1007/
s00268- 020- 05766-x
29. Westwood E, Malla B, Ward J, Lal R, Aryal K (2020) The impact
of a laparoscopic surgery training course in a developing coun-
try. World J Surg 44(10):3284–3289. https:// doi. org/ 10. 1007/
s00268- 020- 05606-y
Surgical Endoscopy
1 3
30. Henao Ó, Escallón J, Green J, Farcas M, Sierra JM, Sánchez W,
Okrainec A (2013) Fundamentos de cirugía laparoscópica en
Colombia con telesimulación: una herramienta adicional para la
formación integral de cirujanos [Fundamentals of laparoscopic
surgery in Colombia using telesimulation: an effective educational
tool for distance learning]. Biomed Rev Inst Nac Salud 33(1):107–
114. https:// doi. org/ 10. 1590/ S0120- 41572 01300 01000 13
Publisher's Note Springer Nature remains neutral with regard to
jurisdictional claims in published maps and institutional affiliations.
... In response to this instructional shortfall, two potential solutions have emerged: technology-based educational tools and peer training. The COVID-19 pandemic and its aftermath have catalyzed the development and adoption of online learning spaces, and, as an example, we have developed a blended learning model that utilizes digital platforms for teaching surgical skills through iterative, asynchronous feedback, allowing to provide effective learning in different skills [7][8][9][10][11]. While these virtual environments have offered a new modality for education, evidence demonstrating their impact has only recently begun to surface [7,8,12]. ...
... The COVID-19 pandemic and its aftermath have catalyzed the development and adoption of online learning spaces, and, as an example, we have developed a blended learning model that utilizes digital platforms for teaching surgical skills through iterative, asynchronous feedback, allowing to provide effective learning in different skills [7][8][9][10][11]. While these virtual environments have offered a new modality for education, evidence demonstrating their impact has only recently begun to surface [7,8,12]. On the other hand, peer and near-peer training have a well-established history in medical Extended author information available on the last page of the article education [13][14][15]. ...
... However, despite the available literature, it remains still unclear whether near-peer medical students can be as effective as residents or experts in teaching roles and there remains a paucity of literature specifically addressing peer teaching in simulations [6,7]. Therefore, exploring the role of peer training in simulation-based medical education and their potential as effective medical trainers could help bridge the instructional gap experienced by many institutions. ...
Article
Technology-mediated learning is changing the way skills are learned, allowing mass training. However, when the trainers are also clinical experts with limited teaching time it can be challenging. The literature supports that non-experts can be trained to become effective trainers, achieving comparable results to expert instructors. This study investigates this potential comparing students and specialty residents in teaching undergraduate students performing basic surgical interventions such as thoracentesis and paracentesis. In this quasi-experimental design study, all participants completed a Train the Trainers (TTT) course, to acquire skills for teaching basic medical procedures (thoracentesis/paracentesis) to third-year medical students through simulation. Trainers were divided into Medical Students as Trainers (MST) or Medical Residents as Trainers (MRT). Students only watched a tutorial before recording their simulated procedures. These recordings were uploaded to a platform for receiving the trainer’s feedback. To assess performance, global-rating-scale (GRS) scores with a maximum of 25 points, from the initial and final assessments were compared. Results were analyzed using non-parametric tests. A total of 618 videos were analyzed. In the MST group, the odds of passing after feedback was 2.443 (CI 1.054–6.43), while in the MRT group, the odds were 1.55 (CI 0.565–4.581). On the GRS, MST significantly improved 4.2 points (p < 0.001) from an initial of 18, while MRT improved by 3.1 points (p < 0.001) from 20. No statistically significant differences were found when comparing both groups (p value = 0.13). The study highlights the potential of medical students as effective instructors in technical skill training, exhibiting comparable outcomes to resident trainers. However, nuances in teaching efficacy, impacted by the inherent differences between student and resident trainers, emphasize the need for further research in this area.
... In our remote and asynchronous program, the learners must record their attempt and upload it to a digital platform where they can receive feedback from one of the expert feedback providers in the network within 72 hours, incorporating this valuable information before training again, as shown in the learning cycle of Figure 4. The feedback is specific, and the expert can select exactly the place in the video where the learner is making a mistake to send him/her inputs to improve his/her performance (21,23,40). ...
... Until 2018, the training modality corresponded to only in-person training at our Simulation Center. The facility includes access to high definition camera laparoscopic simulators, and expert trainers who can provide face-to-face feedback, in a gymnasium modality, allowing trainees to go at their own pace (28,40). ...
... Subsequently, we have shown that it is possible to scale up the remote and asynchronous training modality to more than 14 centers in more than 8 countries, developing a centralized network of experts to provide feedback (40). ...
Article
Full-text available
Introduction. The use of simulation in surgery has made it possible to shorten learning curves through deliberate practice. Although it has been incorporated long ago, there are still no clear recommendations to standardize its development and implementation. This manuscript aims to share recommendations based on our experience of more than twelve years of employing and improving a methodology in laparoscopic surgical simulation. Topics for Reflection. To transfer surgical skills to a trainee, we base our methodology on a three-pillar framework: The hardware and infrastructure (tools to train with), the training program itself (what to do), and the feedback (how to improve). Implementing a cost-effective program is feasible: the hardware does not need to be high fidelity to transfer skills, but the program needs to be validated. These pillars have evolved over time by incorporating technology: the on-site guidance from experts has changed to a remote and asynchronous modality by video recording the trainee’s execution, and by enabling remote and asynchronous feedback. The feedback provider does not necessarily have to be an expert clinician in the subject, but a person previously trained to be a trainer. This allows for deliberate practice until mastery has been reached and learning curves are consolidated. Conclusions. Recommendations based on the experience of our center have been presented, explaining the framework of our strategy. Considering these suggestions, it is hoped that our simulation methodology can aid the development and implementation of effective simulation-based programs for other groups and institutions.
... However, the advent of the pandemic necessitated a transition to digital platforms across the board. This shift transformed not only the methodology behind medical students' simulation training-embracing either a hybrid or fully online approach [5,6,28,29]-but also fundamentally altered the delivery of our 'Train the Trainers' (TTT) course. In response to these unprecedented circumstances, the course adapted to ensure the continuity and effectiveness of our educational system. ...
... The feedback, given by the trained trainers, included text comments, pre-recorded videos illustrating common procedural errors, on-screen drawings, and audio messages, all of which aim to guide trainees comprehensively in refining their practical skills [10]. Over recent years, our institution has effectively implemented this platform, and the ensuing results have been previously published by our team [5,6,28]. ...
Article
With a growing demand for tutoring in medical education, the need for Train the Trainers courses have increased. These courses can be difficult to coordinate between trainer and trainee (trainers in training). This study aimed to evaluate the effectiveness of a digital remote and asynchronous (RA) Train the Trainers (TTT) course compared to an in-person (IP) course. In this quasi-experimental study, we compared an in-person TTT course with a remote and asynchronous TTT course. The course involved theoretical and practical components, and upon completion, the trainees transitioned into instructor roles where they provided feedback on video recordings of third-year medical students performing simulated procedures. Performance of the third-year medical students was analyzed, comparing global rating scores. Data analysis was performed using non-parametric tests considering statistical significance p < 0.05. A total of 108 trainers-in-training completed the TTT course; 30 IP and 78 RA. They assessed 1,016 videos. The first attempt score was 17 (14–20) and 19 (15–22) in IP and RA training, respectively with statistically significant differences (p-value = 0.041). On the second attempt, scores were 23 (20–24) and 23 (20–24) in IP and RA training, respectively. This difference was not statistically significant. The implementation of a remote and asynchronous TTT course yielded comparable results to the traditional in-person method. This new learning modality facilitated increased platform inputs, saw higher first-attempt scores in students, and did not adversely impact their final competency outcomes.
... To address this gap, a digital platform was developed, providing a unique solution to enable remote and asynchronous feedback on pre-recorded videos of trainees. This innovative approach has shown promising results in our institution by effectively facilitating the acquisition of a diverse range of skills such as advanced laparoscopic techniques, cardiopulmonary resuscitation, suturing, and COVID-19-related procedures [7,19,22,[24][25][26][27]. Prior experiences with this platform have not only enhanced our understanding of how to optimize online surgical education, but they also have demonstrated the platform's potential to increase completion rates, improve skill acquisition, and better serve primary care providers and general practitioners-especially those located in rural or underserved regions. ...
... In addition, the digital platform also enables students to access training materials, such as videos with practical examples and tutorials [22,25,26,28]. After receiving their assessment, trainees incorporated the feedback from experts and continued practicing, recording their progress until they successfully met the established approving criteria. ...
Article
Achieving mastery in suturing and minor surgery procedures is relevant for general practitioners who due to geographical barriers have scarce access to training. This study aims to share the experience of scaling up a minor surgery course to an online platform across the country. A formerly in-person minor surgery course was adapted into an online platform in which trainees watched tutorials, trained at-home unsupervised, and then uploaded their attempts, receiving feedback in a remote and asynchronous manner. Feedback inputs were given in four modalities: onscreen drawings, texts, audio, and common mistakes videos. A “surgical kit” was delivered to every student. Trainees were asked to perform basic suturing and five minor surgery procedures: onychocryptosis surgery, cyst removal, nevus removal, abscess drainage, and advancement flap. A group of seven standardized teachers rated all procedures using a modified OSATS Global Rating Scale (GRS) and Procedure-Specific Rating Scales (SRS). The approval criteria for basic suturing skills was established with a minimum of 20 points for global GRS and 16 points in the case of SRS. For the other procedures, the approval criteria was established only using the SRS, with a minimum of 24 points and 21 points, only in the case of the advancement flap. A total of 128 students underwent the course, of which 109 (85.16%) completed it. A total of 1433 videos were uploaded to the platform, receiving 7205 feedback inputs. In basic suturing skills, an average passing score of 23.1 ± 2.1 was obtained meanwhile for onychocryptosis surgery the average passing scores was 22.4 ± 1.71, for cyst removal 22.1 ± 2.1, for nevus removal 22.2 ± 1.72, for abscess drainage 23.0 ± 1.4, and for advancement flap,19.9 ± 1.7. It is feasible to teach a minor surgery skills course through remote and asynchronous feedback using a digital platform. Further studies are needed to assess skills transfer and retention.
... In our institution, in 2017, a digital educational platform to assess technical skills and provide remote and asynchronous feedback was developed [12]. The platform was initially designed to teach basic and advanced laparoscopic skills [13][14][15][16] and has since expanded to other areas, such as COVID-related procedures, reaching over 1800 healthcare workers in Latin America [17,18]. The platform's ability to support assessments of technical skills remotely and asynchronously has proven to be valuable in the current pandemic situation. ...
... With the current method, we estimated that a network of fifty trained evaluators could assess over 2500 trainees per year if they dedicate at least 1 h each week to this purpose. Of note, the examiners could be trained remotely on the digital platform by using objective standardized videos of previous participants [15]. Among the other advantages of the use of remote and asynchronous assessment we find that it also allows making the evaluators blind to the participants, therefore, increasing the objective nature of the assessment. ...
Article
Full-text available
PurposeTo address the gap in surgical certification in countries where mandatory certification only consists of theoretical exams and does not assess technical skills, critical to surgical practice. We aimed to design a large-scale examination to certify surgical skills using simulation models and a digital platform for blinded, remote, and asynchronous assessment.Methods Surgeons completing their professional title revalidation in Chile underwent an eight-station Objective Structured Clinical Examination (OSCE) with simulated procedures designed to test competency levels. All procedures were recorded from two video camera angles and uploaded to a digital platform for blinded video-based remote and asynchronous assessment. Four different assessment scales were used, with a passing score set by experts at 75%. A questionnaire was also conducted to measure participants’ perceptions after the OSCE.ResultsSixty-eight participants were assessed over 9 examinations, with 476 procedures performed, 884 high-resolution videos recorded and uploaded to the platform. The OSCE lasted 200 min (range180–240), with an average online assessment time per procedure of 5–8 min and 56 min per participant. Sixty-six participants (97.05%) passed the exam with a median score of 82.62% (IQR 79,52–85,79%). In addition, all participants rated the examination as very good.Conclusion This study demonstrated that it is feasible to assess a large number of specialists in a short period of time using remote and asynchronous assessment through a digital platform. Using simulation models and digital platforms to objectively assess surgical skills allows for a scalable approach that could enable large-scale examinations of technical surgical skills.
... This program corresponds to an additional module of our laparoscopic training curriculum, offered only once; the basic and advanced modules are completed and successfully approved. Both of these simulation programs have been previously validated and described in literature [12,19,20]. The basic skills training program corresponds to 24 h of theoretical study and 30 h of hands-on training in the skills laboratory of the Catholic University of Chile, and the advanced training program added another 54 h distributed in the same way, completing 60 h of onsite practical training, in which the competencies necessary to perform a manual jejunojejunostomy with good technical quality in less than 20 min, must be demonstrated [12]. ...
... In second place, an interesting advantage is its accessibility and replicability since this training can be easily reproduced at other simulation centers that have the proper equipment. So far, both the basic and advanced laparoscopic training programs are available all over the world with a remote and asynchronous modality [19,20,24]. We believe that if this training program continues to improve and is developed through this modality it would overcome the difficulty of needing available teachers at the same time and place as the trainees. ...
Article
Full-text available
Purpose: Nearly 200,000 laparoscopic Roux-en-Y gastric bypass (LRYGB) are performed yearly. Reported learning curves range between 50 and 150, even 500 cases to decrease the operative risk. Simulation programs could accelerate this learning curve safely; however, trainings for LRYGB are scarce. This study aims to describe and share our 5-year experience of a simulated program designed to achieve proficiency in LRYGB technical skills. Materials and methods: A quasi-experimental design was used. All recruited participants were previously trained with basic and advanced laparoscopic simulation curriculum completing over 50 h of practical training. Ex vivo animal models were used to practice manual and stapled gastrojejunostomy (GJ) and stapled jejunojejunostomy (JJO) in 10, 3, and 4 sessions, respectively. The main outcome was to assess the manual GJ skill acquisition. Pre- and post-training assessments using a Global Rating Scale (GRS; max 25 pts), Specific Rating Scale (SRS; max 20 pts), performance time, permeability, and leakage rates were analyzed. For the stapled GJ and JJO, execution time was registered. Data analysis was performed using parametric tests. Results: In 5 years, 68 trainees completed the program. For the manual GJ's pre- vs post-training assessment, GRS and SRS scores increased significantly (from 17 to 24 and from 13 to 19 points respectively, p-value < 0.001). Permeability rate increased while leakage rate and procedural time decreased significantly. Conclusion: This simulated training program showed effectiveness in improving laparoscopic skills for manual GJ and JJO in a simulated scenario. This new training program could optimize the clinical learning curve. Further studies are needed to assess the transfer of skills to the operating room.
... The ASYNC included texts, audio recordings, drawings annotating the trainee's video, and short example error videos from a library. 14 The error videos lasted no more than 30 seconds and showed the correct technique for a specific part of the procedure. In addition to the specific feedback in response to residents' videos, instructors also provided an objective assessment based on scores using a 9-item global rating scale (GRS) (Appendix 1). ...
Article
Introduction Simulation training that includes deliberate practice is effective for procedural skill training. Delivering feedback remotely and asynchronously has been examined for more cost-efficient training. This prospective randomized study aimed to compare 2 feedback techniques for simulation training: synchronous direct feedback versus asynchronous distance feedback (ASYNC). Methods Forty anesthesia and internal medicine residents were recruited after study approval by the institutional ethics committee. Residents reviewed instructional material on an online platform and performed a pretraining assessment (PRE) for peripherally inserted central catheter (PICC) placement. Each resident was then randomly assigned to 1 of 2 training types, practice with synchronous direct feedback (SYNC) or practice with ASYNC. Training consisted of four, 1-hour practice sessions; each was conducted once per week. Both groups underwent posttraining evaluation (POST). The PRE and POST assessments were videotaped and evaluated by 2 independent, blinded reviewers using a global rating scale. Results Thirty-five residents completed the training program and both evaluations. Both groups had significantly improved global rating scale scores after 4 sessions. The SYNC group improved from 28 to 45 points ( P < 0.01); the ASYNC group improved from 26.5 to 46 points ( P < 0.01). We found no significant between-group differences for the PRE ( P = 0.42) or POST assessments ( P = 0.13). Conclusion This simulation-based training program significantly improved residents' peripherally inserted central venous catheter placement skills using either modality. With these results, we are unable to demonstrate the superiority of synchronous feedback over ASYNC. Asynchronous feedback training modality represents a new, innovative approach for health care procedural skills training.
... Recent advancements in technology, coupled with the need for remote interactions during events like the COVID-19 pandemic, have ushered in innovative modalities for assessments, prominently video-based assessments. These digital evaluations, as highlighted in Quezada, Gaete and Jarry [16][17][18], come with a unique set of challenges and opportunities. The primary interaction between students and trainers in such modalities is typically constrained to the feedback given within or alongside the videos when returned post-assessment. ...
Article
Full-text available
Purpose In recent years, the use of digital platforms for surgical and medical training has increased. Quality feedback is essential when using these methodologies, as it serves as the primary form of interaction between trainers and students. Therefore, there is a need to evaluate feedback using valid and reliable instruments. This scoping review aims to identify assessment tools available in the literature for evaluating feedback in medical education. Materials A scoping review was conducted between April and May 2022, using the databases Medline/PubMed, Web of Science, CINAHL, ERIC, and the Cochrane Library. No publication date limits were used, and English and Spanish were the included languages. The search was supported by the State-of-the-Art-through-Systematic-Review (StArt) software. Two reviewers selected articles based on the inclusion and exclusion criteria, and discrepancies were resolved by a third reviewer. Inclusion criteria were tools or instruments in medical education related to feedback, while tools unrelated to feedback assessment or inaccessibility were excluded. Items were organized to have an overview of the findings. Results From the initial 16,229 articles, 26 feedback quality assessment instruments were found, including the CME Faculty Assessment Instrument, DOCS-FBS, EFFECT instrument, EFFECT-S, EFeCT, Feedback Questionnaire, FEEDME-Feedback culture, FEEDME-Feedback provider, PACT, Quality of the feedback perceived by students, SETQ for Surgical Specialties, StudentPEP project evaluation questionnaire, IQ Instrument, and 13 others without specific names. None was exclusively developed for digital feedback. Conclusion Limited evidence exists on feedback evaluation tools, especially in digital contexts. The identified instruments highlight opportunities for further research and development of feedback tools appropriate for remote and asynchronous surgical training.
Article
Full-text available
Key points What's already known about this topic? Twin to twin syndrome (TTTS) is a serious complication of monochorionic twin pregnancy The treatment of choice is fetoscopic laser ablation of placental anastamoses Simulation plays an important role in teaching this high‐acuity procedure What does this study add? We report the development of a high‐fidelity digital simulation system for teaching TTTS fetoscopic lasers Remote teaching has been demonstrated to work well with this system This simulator is robust, easy to store and assemble and relatively inexpensive.
Article
Full-text available
IntroductionSurgeons training junior colleagues to perform laparoscopic surgery find the ‘apprenticeship’ model of surgical training inadequate. Therefore, the use of training courses involving simulation have become an important way to teach laparoscopic surgery. An annual laparoscopic surgery course began in Nepal in 2013. It is difficult to assess the impact of the course on trainees and demonstrate a subsequent improvement in patient outcomes, but one way is to ask delegates for reflections on their experience of the course and their perception of how it has impacted patients.Methods The course involved simulation and patient-based training. A questionnaire to collect quantitative data and qualitative comments was sent to all 80 previous delegates (at least 9 months after the course) in September 2018.ResultsTwenty-eight delegates responded. The majority demonstrated career progression since completing the course (independent practitioners increased from 7 to 50%) and progression in their practice (18% had performed >20 laparoscopic procedures at the time of the course, vs 70% at the time of the questionnaire). All delegates felt that laparoscopic training is useful in the Nepalese context. Delegates felt the course was useful in developing skills, and improving confidence and safety. Suggestions for improvement included lengthening the course and increasing the amount of practical exposure.Conclusion There was a positive outcome of the course to Kirkpatrick level 2. There is a need to expand the course’s scope to an advanced level, increase its length and start courses in other centres, to ensure the most possible benefit to patients.
Article
Full-text available
Background Simulation training is a validated method for acquiring laparoscopic skills. Training sessions may be sporadic or lack continuity in oversight by instructors since traditional programs mandate in-person teaching and evaluation. This study presents the development, implementation, and results of a novel smartphone application that enables remote teacher–student interaction. This interface is used to complete a validated program that provides learner-specific feedback. Outcomes of training via Lapp were compared to outcomes of traditional in-person training. Methods A web-based and mobile iOS and Android application (Lapp) was developed to enable a remote student–teacher interaction. Instructors use Lapp to assess video recorded training sessions of students at distant locations and guide them through the laparoscopic skill course with specific and personalized feedback. Surgical trainees at two remote training centers were taught using Lapp. A control group was assessed during traditional simulation training at the training facility, with in-person feedback. Pre- and post-training performances were video recorded for each trainee and blindly evaluated by two experts using a global rating scale (GRS) and a specific rating scale (SRS). Results A total of 30 trainees were trained via Lapp and compared with 25 locally taught. Performance in the Lapp group improved significantly after the course in both GRS and SRS scores, from 15 [6–17] to 23 [20–25], and from 12 [11–15] to 18 [15–20], respectively. The results between both groups were comparable. Conclusion Laparoscopic simulation training using a mobile app is as effective as in-person instruction in teaching advanced laparoscopic surgical skills. Lapp provides an effective method of teaching through simulation remotely and may allow expansion of robust simulation training curriculums.
Article
Background The use of simulation-based training tools within surgery is rapidly increasing and has demonstrated promising alternative training modalities allowing for surgical skill enhancement despite workplace pressures. Whilst many simulators have been investigated for their validity, this has not been demonstrated across all domains. This review aims to identify the status of simulation-based training tools in general surgery in the current literature, assess their validity and determine their effectiveness. Methods OVID Medline and Embase databases were searched for English language articles describing the validation of a simulator for general surgery-specific procedures between 2000-2020. Studies were reviewed according to Messick’s validity framework and rated in each domain. A modified version of translational outcomes described by McGaghie et al. were used to determine the level of effectiveness (LoE) of each simulator. Results A total of 9653 articles were screened and 97 articles were identified to determine the LoE of the simulators. The highest rating for each validity domain was achieved by 30 models/training courses for content validity, 48 for response processes, 5 for internal structure, 40 for relations to other variables and 10 for consequences. Two simulators gained LoE >2 showing skill transfer downstream of the simulator. Conclusion The varying ratings across each validity domain for the simulators show that evidence of complete validity is poor. Only 2 simulators were awarded LoE >2, indicating further research is needed in order to substantiate the use of simulation in improving patient outcomes.
Article
Statement: The sudden rise of critically ill patients secondary to the SARS-CoV-2 pandemic has triggered a surge in healthcare response. This project's goal was to provide essential cognitive and technical skills to healthcare professionals returning to the workforce or reassigned to critical care clinical duties during the COVID-19 pandemic. The plan included the implementation of 4 distance-based simulation training programs, with asynchronous personalized feedback. The courses allowed the acquisition of skills for the complete critical care patient management chain: use of personal protection equipment, use of a high-flow nasal cannula, endotracheal intubation, and prone positioning. Participants logged into the platform, reviewed material, practiced while recording the session, and uploaded the video through the training platform. The expert tutor remotely delivered asynchronous feedback. Participants trained remotely until achieving course approval. Remote-based simulation seems a feasible and attractive alternative to provide adequate educational solutions, especially for remote and rural areas.
Article
Background: Feedback is a pivotal cornerstone and a challenge in psychomotor training. There are different teaching methodologies; however, some may be less effective. Methods: A prospective randomized controlled trial was conducted in 130 medical students to compare the effectiveness of the video-guided learning (VLG), peer-feedback (PFG) and the expert feedback (EFG) for teaching suturing skills. The program lasted 4 weeks. Students were recorded making 3-simple stitches (pre-assessment and post-assessment). The primary outcome was a global scale (OSATS). The secondary outcomes were performance time, specific rating scale (SRS) and the impact of the intervention (IOI), defined as the variation between the final and initial OSATS and SRS scores. Results: No significant differences were found between PFG and EFG in post-assessment results of OSATS, SRS scores or in the IOI for OSATS and SRS scores. Post-assessment results of PFG and EFG were significantly superior to VLG in OSATS and SRS scores [(19.8 (18.5-21); 16.6 (15.5-17.5)) and (20.3 (19.88-21); 16.8 (16-17.5)) vs (15.7 (15-16); 13.3 (12.5-14)) (p < 0.05)], respectively. The results of PFG and EFG were significantly superior to VLG in the IOI for OSATS [7 (4.5-9) and 7.4 (4.88-10) vs 3.5 (1.5-6) (p < 0.05)] and SRS scores [5.4 (3.5-7) and 6.3 (4-8.5) vs 3.1 (1.13-4.88) (p < 0.05)], respectively. Conclusion: The video-guided learning methodology without any kind of feedback is not enough for teaching suturing skills compared to expert or peer feedback. The peer feedback methodology appears to be a viable alternative to handling the emerging demands in medical education.
Article
Context Changes to surgical training programmes in the UK has led to a reduction in theatre time for trainees, and an increasing reliance on simulation to provide procedural experience. Whilst simulation offers opportunity for repetitive practice, the effectiveness of simulation as an educational intervention for developing procedural surgical skills is unclear. Methods A systematic literature review was undertaken to retrieve all studies describing simulation-based medical education (SBME) interventions for the development of procedural surgical skills using the MEDLINE, PsycINFO, CINAHL, EMBASE and PUBMED databases. Studies measuring skill retention or demonstrating transferability of skills for improving patient outcomes were included in the review. Results SBME is superior to no training and can lead to improvement in procedural surgical skills, such that skills transfer from simulated environments into theatre. SBME results in minimal skill degradation after 2 weeks, although more significant decay results after >90 days. Many studies recruited <10 participants, used a variety of methods and were restricted to endoscopic surgical techniques. All studies did not compare interventions with non-SBME teaching methods for developing procedural surgical skills. No studies compared the curriculum design of different surgical training programmes. Conclusions SBME interventions are effective for developing procedural skills in surgery. SBME interventions are also effective for preventing the decay of procedural surgical skills. Although no studies demonstrate non-inferiority of SBME interventions compared to time in theatre developing skills, SBME interventions do enable the transfer of skills into theatre, and the potential for improving patient outcomes.
Article
Background: The surgical workforce particularly in rural regions needs novel approaches to reinforce the skills and confidence of health practitioners. Although conventional telementoring systems have proven beneficial to address this gap, the benefits of platforms of augmented reality-based telementoring in the coaching and confidence of medical personnel are yet to be evaluated. Methods: A total of 20 participants were guided by remote expert surgeons to perform leg fasciotomies on cadavers under one of two conditions: (1) telementoring (with our System for Telementoring with Augmented Reality) or (2) independently reviewing the procedure beforehand. Using the Individual Performance Score and the Weighted Individual Performance Score, two on-site, expert surgeons evaluated the participants. Postexperiment metrics included number of errors, procedure completion time, and self-reported confidence scores. A total of six objective measurements were obtained to describe the self-reported confidence scores and the overall quality of the coaching. Additional analyses were performed based on the participants' expertise level. Results: Participants using the System for Telementoring with Augmented Reality received 10% greater Weighted Individual Performance Score (P = .03) and performed 67% fewer errors (P = .04). Moreover, participants with lower surgical expertise that used the System for Telementoring with Augmented Reality received 17% greater Individual Performance Score (P = .04), 32% greater Weighted Individual Performance Score (P < .01) and performed 92% fewer errors (P < .001). In addition, participants using the System for Telementoring with Augmented Reality reported 25% more confidence in all evaluated aspects (P < .03). On average, participants using the System for Telementoring with Augmented Reality received augmented reality guidance 19 times on average and received guidance for 47% of their total task completion time. Conclusion: Participants using the System for Telementoring with Augmented Reality performed leg fasciotomies with fewer errors and received better performance scores. In addition, participants using the System for Telementoring with Augmented Reality reported being more confident when performing fasciotomies under telementoring. Augmented Reality Head-Mounted Display-based telementoring successfully provided confidence and coaching to medical personnel.
Article
Objective: Active learning techniques result in greater knowledge acquisition compared to passive methods. For medical students with limited hands-on operative experiences, virtual reality platforms represent active learning and may enhance procedural training. We hypothesize that virtual reality simulators like Toolkit for Illustration of Procedures in Surgery (TIPS) are a more effective modality in teaching laparoscopic surgical techniques to medical students when compared to passive learning tools like videos. Design: In this crossover study, participants were randomly assigned to perform either a TIPS laparoscopic appendectomy followed by video of a laparoscopic cholecystectomy, or video of a laparoscopic appendectomy followed by TIPS laparoscopic cholecystectomy. A knowledge assessment followed each intervention. A postsurvey was used to gather feedback and subjective impressions of the learning experience. Setting: University of Central Florida College of Medicine. Participants: Second, third, and fourth-year medical students (n = 37). Results: Validation of the content assessments revealed strong internal consistency (Cronbach's α = 0.73). A 2-tailed Fisher's exact test revealed that the video had greater ease of use (p = 0.032), but TIPS had greater utility as a learning tool (p < 0.001) and instilled greater confidence in the ability to reproduce procedural steps (p < 0.001). A 2-tailed t test of the average content quiz scores revealed no significant difference in percentage correct between groups on the laparoscopic appendectomy quiz (p = 0.772), but a difference favoring video learning on the laparoscopic cholecystectomy quiz (p = 0.042) CONCLUSIONS: Video and TIPS both enhanced different aspects of student learning; however, the active TIPS platform produced greater confidence in the ability to reproduce the steps of the procedure and had greater utility as a learning strategy. Videos are simple to use and can serve a complementary role in curriculum design.