A Randomized Prospective Blinded Study Validating Acquistion of Ureteroscopy Skills Using A Computer Based Virtual Reality Endourological Simulator

No AccessJournal of UrologyCLINICAL UROLOGY: Original Articles1 Nov 2002A Randomized Prospective Blinded Study Validating Acquistion of Ureteroscopy Skills Using A Computer Based Virtual Reality Endourological Simulator JAMES D. WATTERSON, DARREN T. BEIKO, JAMES K. KUAN, and JOHN D. DENSTEDT JAMES D. WATTERSONJAMES D. WATTERSON , DARREN T. BEIKODARREN T. BEIKO , JAMES K. KUANJAMES K. KUAN , and JOHN D. DENSTEDTJOHN D. DENSTEDT View All Author Informationhttps://doi.org/10.1016/S0022-5347(05)64265-6AboutFull TextPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissionsReprints ShareFacebookLinked InTwitterEmail Abstract Purpose: Surgical simulation has emerged in the last decade as a potential tool for aiding acquisition of technical skills, including anesthesia protocols, trauma management, cardiac catheterization and laparoscopy. We evaluate and validate the use of a computer based ureteroscopy simulator (URO Mentor, Simbionix Ltd., Lod, Israel) in the acquisition of basic ureteroscopic skills. Materials and Methods: We assessed 20 novice trainees for the ability to perform basic ureteroscopic tasks on a computer based ureteroscopy simulator. Participants were randomized to receive individualized mentored instruction or no additional training, and subsequently underwent post-testing. Pre-training and post-training improvement in performance was assessed by objective simulator based measurements. Subjective overall performance was rated using a validated endourological global rating scale by an observer blinded to subject training status. Results: Demographics and pre-test scores were similar between groups. Post-testing revealed a significant effect of training on objective and subjective measurements. Spearman rank correlation demonstrated a significant association between objective simulator based measurements and the endourological global rating scale. Conclusions: Use of a computer based ureteroscopy simulator resulted in rapid acquisition of ureteroscopic skills in trainees with no prior surgical training. Results of this study demonstrate the use of a virtual reality ureteroscopy simulator in endourological training. Correlation of simulator based measurements with a previously validated endourological global rating scale provides initial validation of the ureteroscopy simulator for the assessment of ureteroscopic skills. References 1 : Anaesthetic simulators: training for the broader health-care profession. Aust N Z J Surg2000; 70: 735. Crossref, Medline, Google Scholar 2 : Use of a human patient simulator in the development of resident trauma management skills. J Trauma2001; 51: 17. Crossref, Medline, Google Scholar 3 : The virtual reality arthroscopy training simulator. Stud Health Technol Inform1998; 50: 13. Medline, Google Scholar 4 : Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human-computer interface. Ann R Coll Surg Engl1999; 81: 281. Medline, Google Scholar 5 : Virtual reality surgical simulation in endoscopic urologic surgery. Stud Health Technol Inform1996; 29: 157. Medline, Google Scholar 6 : The URO Mentor: development and evaluation of a new computer-based interactive training system for virtual life-like simulation of diagnostic and therapeutic endourological procedures. BJU Int2002; 89: 174. Crossref, Medline, Google Scholar 7 : A novel approach to endourological training: training at the Surgical Skills Center. J Urol2001; 166: 1261. Link, Google Scholar 8 : An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures. IEEE Trans Biomed Eng1990; 37: 757. Crossref, Medline, Google Scholar 9 : A computer generated interactive transurethral prostatic resection simulator. J Urol1999; 162: 1633. Link, Google Scholar 10 : The 'HysteroTrainer'—an in vitro simulator for hysteroscopy and falloposcopy. Experimental and clinical background and technical realisation including the development of organ modules for electrothermal treatment. Contrib Gynecol Obstet2000; 20: 171. Crossref, Medline, Google Scholar 11 : Virtual reality simulators for dermatologic surgery: measuring their validity as a teaching tool. Dermatol Surg2001; 27: 370. Medline, Google Scholar 12 : PreOp endoscopic simulator: a PC-based immersive training system for bronchoscopy. Stud Health Technol Inform1999; 62: 76. Medline, Google Scholar 13 : ENT endoscopic surgical training simulator. Stud Health Technol Inform1997; 39: 518. Medline, Google Scholar 14 : The financial impact of teaching surgical residents in the operating room. Am J Surg1999; 177: 28. Crossref, Medline, Google Scholar 15 : Virtual reality, telesurgery, and the new world order of medicine. J Image Guid Surg1995; 1: 12. Crossref, Medline, Google Scholar 16 : A virtual reality module for intravenous catheter placement. Am J Surg1999; 177: 171. Crossref, Medline, Google Scholar From the Division of Urology, The University of Western Ontario, London, Ontario, Canada© 2002 by American Urological Association, Inc.FiguresReferencesRelatedDetailsCited by Doizi S and Koskas L (2022) Impact de la formation fondée sur la simulation en endo-urologie : revue systématique de la littératureProgrès en Urologie, 10.1016/j.purol.2022.07.139, VOL. 32, NO. 12, (813-829), Online publication date: 1-Oct-2022. Sadeghi Milani A, Cecil-Xavier A, Gupta A, Cecil J and Kennison S (2022) A Systematic Review of Human–Computer Interaction (HCI) Research in Medical and Other Engineering FieldsInternational Journal of Human–Computer Interaction, 10.1080/10447318.2022.2116530, (1-22) Gupta A, Cecil J, Pirela-Cruz M, Kennison S and Hicks N (2022) Need for Human Extended Reality Interaction (HXRI) Framework for the design of Extended Reality-based Training Environments for Surgical Contexts 2022 IEEE 10th International Conference on Serious Games and Applications for Health(SeGAH), 10.1109/SEGAH54908.2022.9978563, 978-1-6654-8439-8, (1-8) Tang Y, Chau K, Kwok A, Zhu T and Ma X (2022) A systematic review of immersive technology applications for medical practice and education - Trends, application areas, recipients, teaching contents, evaluation methods, and performanceEducational Research Review, 10.1016/j.edurev.2021.100429, VOL. 35, (100429), Online publication date: 1-Feb-2022. Kallidonis P, Tsaturyan A, Liourdi D and Somani B (2022) Cystoscopy and Ureteroscopy Simulation Practical Simulation in Urology, 10.1007/978-3-030-88789-6_10, (157-180), . Dagnaes-Hansen J, Konge L, Andreassen K and Hansen R (2021) Virtual reality simulator metrics cannot be used to assess competence in ureteronephroscopy and stone removal – a validation studyScandinavian Journal of Urology, 10.1080/21681805.2021.1960599, VOL. 55, NO. 5, (399-403), Online publication date: 3-Sep-2021. Aydın A, Baig U, Al-Jabir A, Sarıca K, Dasgupta P and Ahmed K (2021) Simulation-Based Training Models for Urolithiasis: A Systematic ReviewJournal of Endourology, 10.1089/end.2020.0408, VOL. 35, NO. 7, (1098-1117), Online publication date: 1-Jul-2021. Yan H, Liu H, Lu Y, Li T and Qiu X (2021) "Dawn of South Lake"——Design and Implementation of Immersive Interactive System Based on Virtual Reality Technology BDET 2021: 2021 the 3rd International Conference on Big Data Engineering and Technology, 10.1145/3474944.3474959, 9781450389280, (88-93), Online publication date: 16-Jan-2021. Gupta A, Cecil J and Pirela-Cruz M (2020) Immersive Virtual Reality based Training and Assessment of an Orthopedic Surgical Process 2020 IEEE International Systems Conference (SysCon), 10.1109/SysCon47679.2020.9381832, 978-1-7281-5365-0, (1-7) Gupta A, Cecil J and Pirela-Cruz M (2020) A Cyber-Human based Integrated Assessment approach for Orthopedic Surgical Training 2020 IEEE 8th International Conference on Serious Games and Applications for Health(SeGAH), 10.1109/SeGAH49190.2020.9201817, 978-1-7281-9042-6, (1-8) Raskolnikov D, Chen T and Sweet R (2020) Simulation and Ureteroscopy (URS) Ureteroscopy, 10.1007/978-3-030-26649-3_16, (221-237), . Abe T, Dar F, Amnattrakul P, Aydin A, Raison N, Shinohara N, Khan M, Ahmed K and Dasgupta P (2019) The effect of repeated full immersion simulation training in ureterorenoscopy on mental workload of novice operatorsBMC Medical Education, 10.1186/s12909-019-1752-2, VOL. 19, NO. 1, Online publication date: 1-Dec-2019. Gupta A, Cecil J, Pirela-Cruz M and Ramanathan P A Virtual Reality Enhanced Cyber-Human Framework for Orthopedic Surgical TrainingIEEE Systems Journal, 10.1109/JSYST.2019.2896061, VOL. 13, NO. 3, (3501-3512) Cecil J, Gupta A, Pirela-Cruz M and Ramanathan P (2019) WITHDRAWN: An IoMT-based Cyber Training Framework for Orthopedic Surgery using Next Generation Internet TechnologiesInformatics in Medicine Unlocked, 10.1016/j.imu.2019.100234, (100234), Online publication date: 1-Aug-2019. Abboudi H, Shamim Khan M, Dasgupta P and Ahmed K (2019) Simulation in Urology Blandy's Urology, 10.1002/9781118863343.ch1.3, (27-38), Online publication date: 22-Mar-2019. Zhao Z and Sweet R (2018) Endoscopic Training/Simulation Smith's Textbook of Endourology, 10.1002/9781119245193.ch10, (159-172) Kowalewski T and Lendvay T (2019) Performance Assessment Comprehensive Healthcare Simulation: Surgery and Surgical Subspecialties, 10.1007/978-3-319-98276-2_9, (89-105), . Baas W and Schwartz B (2019) Simulation in Urology Comprehensive Healthcare Simulation: Surgery and Surgical Subspecialties, 10.1007/978-3-319-98276-2_24, (289-317), . Cecil J, Gupta A, Pirela-Cruz M and Ramanathan P (2018) A Network-Based Virtual Reality Simulation Training Approach for Orthopedic SurgeryACM Transactions on Multimedia Computing, Communications, and Applications, 10.1145/3232678, VOL. 14, NO. 3, (1-21), Online publication date: 31-Aug-2018. Baas W, Davis M and Schwartz B (2018) Simulation in Surgery Surgeons as Educators, 10.1007/978-3-319-64728-9_24, (439-488), . Yiasemidou M, de Siqueira J, Tomlinson J, Glassman D, Stock S and Gough M (2017) "Take-home" box trainers are an effective alternative to virtual reality simulatorsJournal of Surgical Research, 10.1016/j.jss.2017.02.038, VOL. 213, (69-74), Online publication date: 1-Jun-2017. Yonghang Tai , Wei L, Zhou H, Nahavandi S, Junsheng Shi and Qiong Li (2016) Integrating virtual reality and haptics for renal puncture surgical simulator 2016 2nd IEEE International Conference on Computer and Communications (ICCC), 10.1109/CompComm.2016.7924747, 978-1-4673-9026-2, (480-484) Aydin A, Raison N, Khan M, Dasgupta P and Ahmed K (2016) Simulation-based training and assessment in urological surgeryNature Reviews Urology, 10.1038/nrurol.2016.147, VOL. 13, NO. 9, (503-519), Online publication date: 1-Sep-2016. Stunt J, Kerkhoffs G, Horeman T, van Dijk C and Tuijthof G (2014) Validation of the PASSPORT V2 training environment for arthroscopic skillsKnee Surgery, Sports Traumatology, Arthroscopy, 10.1007/s00167-014-3213-0, VOL. 24, NO. 6, (2038-2045), Online publication date: 1-Jun-2016. Borsci S, Lawson G, Jha B, Burges M and Salanitri D (2016) Effectiveness of a multidevice 3D virtual environment application to train car service maintenance proceduresVirtual Reality, 10.1007/s10055-015-0281-5, VOL. 20, NO. 1, (41-55), Online publication date: 1-Mar-2016. Hu W, Feng J, Wang J, Song Y, Xu X, Zhou H and Huang C (2015) Ureteroscopy and cystoscopy training: comparison between transparent and non-transparent simulatorsBMC Medical Education, 10.1186/s12909-015-0380-8, VOL. 15, NO. 1, Online publication date: 1-Dec-2015. Nomura T, Mamada Y, Nakamura Y, Matsutani T, Hagiwara N, Fujita I, Mizuguchi Y, Fujikura T, Miyashita M and Uchida E (2015) Laparoscopic skill improvement after virtual reality simulator training in medical students as assessed by augmented reality simulatorAsian Journal of Endoscopic Surgery, 10.1111/ases.12209, VOL. 8, NO. 4, (408-412), Online publication date: 1-Nov-2015. Stunt J, Kerkhoffs G, van Dijk C and Tuijthof G (2014) Validation of the ArthroS virtual reality simulator for arthroscopic skillsKnee Surgery, Sports Traumatology, Arthroscopy, 10.1007/s00167-014-3101-7, VOL. 23, NO. 11, (3436-3442), Online publication date: 1-Nov-2015. Cloutier J and Traxer O (2015) Do high-fidelity training models translate into better skill acquisition for an endourologist?Current Opinion in Urology, 10.1097/MOU.0000000000000143, VOL. 25, NO. 2, (143-152), Online publication date: 1-Mar-2015. Brunckhorst O, Aydin A, Abboudi H, Sahai A, Khan M, Dasgupta P and Ahmed K (2015) Simulation-Based Ureteroscopy Training: A Systematic ReviewJournal of Surgical Education, 10.1016/j.jsurg.2014.07.003, VOL. 72, NO. 1, (135-143), Online publication date: 1-Jan-2015. Sea J and Sundaram C (2015) Urologic Surgery Training Using Computer-Assisted Simulators Advances in Image-Guided Urologic Surgery, 10.1007/978-1-4939-1450-0_19, (243-263), . Vallas C, Alexiou K, Alexandrou A and Economou N (2015) Different forms of laparoscopic training: Review and comparisonΜορφές λαπαροσκοπικής εκπαίδευσης.ανασκόπηση και συγκρίσειςHellenic Journal of Surgery, 10.1007/s13126-014-0157-2, VOL. 86, NO. 6, (337-346), Online publication date: 1-Nov-2014. Seitz C and Fajkovic H (2019) Training in ureteroscopy for urolithiasisArab Journal of Urology, 10.1016/j.aju.2013.08.010, VOL. 12, NO. 1, (42-48), Online publication date: 1-Mar-2014. Marchi D, Esposito M, Gentile I and Gilio F (2014) Laparoscopic Cholecystectomy: Training, Learning Curve, and Definition of Expert Laparoscopic Cholecystectomy, 10.1007/978-3-319-05407-0_11, (141-147), . Nagendran M, Gurusamy K, Aggarwal R, Loizidou M and Davidson B (2013) Virtual reality training for surgical trainees in laparoscopic surgeryCochrane Database of Systematic Reviews, 10.1002/14651858.CD006575.pub3 Schlickum M, Felländer-Tsai L, Hedman L and Henningsohn L (2012) Endourological simulator performance in female but not male medical students predicts written examination results in basic surgery Scandinavian Journal of Urology, 10.3109/00365599.2012.693538, VOL. 47, NO. 1, (38-42), Online publication date: 1-Feb-2013. Al-Kandari A (2013) Difficulties in Endourologic Training Difficult Cases in Endourology, 10.1007/978-1-84882-083-8_32, (315-325), . Krambeck A, Gettman M and de Cógáin M (2013) Surgical Simulation Ureteroscopy, 10.1007/978-1-62703-206-3_39, (443-451), . Chummun K, Burke J, O'Sullivan R and Prendiville W (2011) The influence of a 'take home' box trainer on laparoscopic performance for gynaecological surgeonsGynecological Surgery, 10.1007/s10397-011-0720-6, VOL. 9, NO. 3, (303-308), Online publication date: 1-Sep-2012. Arora S, Undre S and Kneebone R (2012) Simulation and Training in Minimally Invasive Surgery Simulation Training in Laparoscopy and Robotic Surgery, 10.1007/978-1-4471-2930-1_4, (31-38), . Ahmed K, Zakri R, Rowland S, Joyce A, Challacombe B, Dasgupta P and Khan M (2011) What is the current status of revalidation in urology?BJU International, 10.1111/j.1464-410X.2011.10375.x, VOL. 108, NO. 8, (1248-1253), Online publication date: 1-Oct-2011. Schreuder H, van Hove P, Janse J, Verheijen R, Stassen L and Dankelman J (2011) An "Intermediate Curriculum" for Advanced Laparoscopic Skills Training with Virtual Reality SimulationJournal of Minimally Invasive Gynecology, 10.1016/j.jmig.2011.05.017, VOL. 18, NO. 5, (597-606), Online publication date: 1-Sep-2011. Sarker S and Delaney C (2010) Feasibility of self-appraisal in assessing operative performance in advanced laparoscopic colorectal surgeryColorectal Disease, 10.1111/j.1463-1318.2010.02271.x, VOL. 13, NO. 7, (805-810), Online publication date: 1-Jul-2011. Ahmed K, Jawad M, Abboudi M, Gavazzi A, Darzi A, Athanasiou T, Vale J, Khan M and Dasgupta P (2011) Effectiveness of Procedural Simulation in Urology: A Systematic ReviewJournal of Urology, VOL. 186, NO. 1, (26-34), Online publication date: 1-Jul-2011. Corona R, Verguts J, Binda M, Molinas C, Schonman R and Koninckx P (2011) The impact of the learning curve on adhesion formation in a laparoscopic mouse modelFertility and Sterility, 10.1016/j.fertnstert.2011.04.057, VOL. 96, NO. 1, (193-197), Online publication date: 1-Jul-2011. Olweny E and Pearle M (2011) Update on Resident Training Models for UreteroscopyCurrent Urology Reports, 10.1007/s11934-010-0169-6, VOL. 12, NO. 2, (115-120), Online publication date: 1-Apr-2011. Lendvay T, Rosen J and Hannaford B (2011) Telerobotics: Its Future in Clinical Application Pediatric Robotic and Reconstructive Urology, 10.1002/9781444345292.ch44, (314-327), Online publication date: 22-Mar-2011. Arora S, Lamb B, Undre S, Kneebone R, Darzi A and Sevdalis N (2010) Framework for incorporating simulation into urology trainingBJU International, 10.1111/j.1464-410X.2010.09563.x, VOL. 107, NO. 5, (806-810), Online publication date: 1-Mar-2011. Sarker S, Maciocco M, Zaman A and Kumar I (2010) Operative performance in laparoscopic cholecystectomy using the Procedural-Based Assessment toolThe American Journal of Surgery, 10.1016/j.amjsurg.2009.10.025, VOL. 200, NO. 3, (334-340), Online publication date: 1-Sep-2010. Schout B, Ananias H, Bemelmans B, D'Ancona F, Muijtjens A, Dolmans V, Scherpbier A and Hendrikx A (2009) Transfer of cysto-urethroscopy skills from a virtual-reality simulator to the operating room: a randomized controlled trialBJU International, 10.1111/j.1464-410X.2009.09049.x, VOL. 106, NO. 2, (226-231) Ahmed K, Jawad M, Dasgupta P, Darzi A, Athanasiou T and Khan M (2010) Assessment and maintenance of competence in urologyNature Reviews Urology, 10.1038/nrurol.2010.81, VOL. 7, NO. 7, (403-413), Online publication date: 1-Jul-2010. Sarker S, Kumar I and Delaney C (2010) Assessing Operative Performance in Advanced Laparoscopic Colorectal SurgeryWorld Journal of Surgery, 10.1007/s00268-010-0486-4, VOL. 34, NO. 7, (1594-1603), Online publication date: 1-Jul-2010. Schout B, Hendrikx A, Scheele F, Bemelmans B and Scherpbier A (2009) Validation and implementation of surgical simulators: a critical review of present, past, and futureSurgical Endoscopy, 10.1007/s00464-009-0634-9, VOL. 24, NO. 3, (536-546), Online publication date: 1-Mar-2010. White M, DeHaan A, Stephens D, Maes A and Maatman T (2009) Validation of a High Fidelity Adult Ureteroscopy and Renoscopy SimulatorJournal of Urology, VOL. 183, NO. 2, (673-677), Online publication date: 1-Feb-2010. Schout B, Muijtjens A, Hendrikx A, Ananias H, Dolmans V, Scherpbier A and Bemelmans B (2010) Acquisition of flexible cystoscopy skills on a virtual reality simulator by experts and novicesBJU International, 10.1111/j.1464-410X.2009.08733.x, VOL. 105, NO. 2, (234-239), Online publication date: 1-Jan-2010. Gamboa A and McDougall E (2010) Training Implications for Stone Management Urinary Tract Stone Disease, 10.1007/978-1-84800-362-0_48, (577-587), . Connors J, Sacks D, Black C, McIff E, Stallmeyer M, Cole J, Rowley H, Wojak J, Mericle R, Murphy K and Cardella J (2009) Training Guidelines for Intra-arterial Catheter-directed Treatment of Acute Ischemic Stroke: A Statement from a Special Writing Group of the Society of Interventional RadiologyJournal of Vascular and Interventional Radiology, 10.1016/j.jvir.2009.10.005, VOL. 20, NO. 12, (1507-1522), Online publication date: 1-Dec-2009. Connors J, Sacks D, Furlan A, Selman W, Russell E, Stieg P and Hadley M (2009) Training, Competency, and Credentialing Standards for Diagnostic Cervicocerebral Angiography, Carotid Stenting, and Cerebrovascular InterventionJournal of Vascular and Interventional Radiology, 10.1016/j.jvir.2009.04.003, VOL. 20, NO. 7, (S292-S301), Online publication date: 1-Jul-2009. Van Herzeele I, Aggarwal R, Malik I, Gaines P, Hamady M, Darzi A, Cheshire N and Vermassen F (2009) Validation of Video-based Skill Assessment in Carotid Artery StentingEuropean Journal of Vascular and Endovascular Surgery, 10.1016/j.ejvs.2009.03.008, VOL. 38, NO. 1, (1-9), Online publication date: 1-Jul-2009. Laguna M, de Reijke T and de la Rosette J (2009) How far will simulators be involved into training?Current Urology Reports, 10.1007/s11934-009-0019-6, VOL. 10, NO. 2, (97-105), Online publication date: 1-Mar-2009. Gurusamy K, Aggarwal R, Palanivelu L, Davidson B and Gurusamy K (2009) Virtual reality training for surgical trainees in laparoscopic surgery Cochrane Database of Systematic Reviews, 10.1002/14651858.CD006575.pub2 Undre S, Arora S and Sevdalis N (2009) Surgical Performance, Human Error and Patient Safety in Urological SurgeryBritish Journal of Medical and Surgical Urology, 10.1016/j.bjmsu.2008.11.004, VOL. 2, NO. 1, (2-10), Online publication date: 1-Jan-2009. Stone M and B Virtual in Urology, Schout B, Hendrikx A, Scherpbier A and Bemelmans B Update on Training Models in A Systematic Review of the between and Urology, VOL. NO. 6, Online publication date: de la Rosette J, Laguna M, J and P Training in Urology, VOL. NO. 5, Online publication date: Lendvay T, P, Sweet R and C validation of a virtual-reality of Robotic Surgery, VOL. 2, NO. 3, Online publication date: Gurusamy K, Aggarwal R, Palanivelu L and Davidson B Systematic review of randomized controlled on the of virtual reality training for laparoscopic Journal of Surgery, VOL. NO. 9, Online publication date: G, J, G, J, Pearle M, Sweet R and McDougall E Surgical Simulation: A Urological of Urology, VOL. NO. 5, Online publication date: Aggarwal R, T, K, T and Darzi A and of Surgical Skills in the of Surgery, VOL. NO. 2, Online publication date: D and J Advances in of VOL. 34, NO. 3, Online publication date: Gurusamy K, Aggarwal R, Palanivelu L, Davidson B and Gurusamy K Virtual reality training for surgical trainees in laparoscopic surgery Cochrane Database of Systematic Reviews, S, G, J, A and A Management by Gynecology, VOL. NO. 6, Online publication date: V, J, C, S, K, J, A, J, J and R From the to the Surgical The for of the on of Surgical Research, VOL. NO. 1, Online publication date: C, D, L, J and Gettman M (2018) The of Medical Simulation in American Urological Training An Assessment by of Urology, VOL. NO. 1, Online publication date: C and S Simulation in . B, E, B, B, V, J, Pearle M, S and J (2018) A Prospective Study Validating the Acquisition of System Skills Using a Computer Based Virtual Reality Surgical of Urology, VOL. NO. 5, Online publication date: C, W and G Technology for and Urologic of VOL. NO. 3, Online publication date: E, K and R Virtual reality ureteroscopy simulator as a tool for assessing endourological Journal of Urology, VOL. 13, NO. 7, Online publication date: S, D and S A of the of and virtual reality VOL. 32, NO. 4, Online publication date: O, M, C, A, R, Seitz M, B, R, A and C virtual reality simulator for of lower VOL. NO. 6, Online publication date: E, G, K, L, D, Pearle M and J Assessment of basic human performance predicts performance of American Journal of Surgery, VOL. NO. 6, Online publication date: A, L, de la A, R, D, S and C Simulation training in urologic Urology Reports, VOL. 7, NO. 2, Online publication date: L, P, A, J, P, D and G Surgical of Surgery, VOL. NO. 3, Online publication date: S, J, C, B, R, D, A and K Simulator assessment of of Vascular Surgery, VOL. NO. 1, Online publication date: M and R Training on Models in Urology, VOL. NO. 3, Online publication date: S, P, A, J and T A study of skills in virtual and Endoscopy, VOL. 19, NO. 2, Online publication date: Connors J, Sacks D, Furlan A, Selman W, Russell E, Stieg P and Hadley M Training, Competency, and Credentialing Standards for Diagnostic Cervicocerebral Angiography, Carotid Stenting, and Cerebrovascular VOL. NO. 1, (26-34), Online publication date: Connors J, Sacks D, Furlan A, Selman W, Russell E, Stieg P and Hadley M Training, Competency, and Credentialing Standards for Diagnostic Cervicocerebral Angiography, Carotid Stenting, and Cerebrovascular InterventionJournal of Vascular and Interventional Radiology, VOL. 15, NO. 12, Online publication date: Connors J Training, Competency, and Credentialing Standards for Carotid in Vascular and Interventional Radiology, VOL. 7, NO. 4, Online publication date: R, T, P, S and R (2018) of Urology, VOL. NO. 5, Online publication date: K, L, M, C, J and M (2018) A of Urology, VOL. NO. 2, Online publication date: E, S, K, R, E, R and K (2018) A of Urology, VOL. NO. 1, Online publication date: and G Advances in and in of VOL. NO. 1, Online publication date: (2018) of Urology, VOL. NO. 1, Online publication date: 2002 by American Urological Association, Author JAMES D. WATTERSON by this DARREN T. BEIKO by this JAMES K. KUAN by this JOHN D. DENSTEDT with and by this All