Cost- effectiveness Bowling 2010 1 Freshfrozen cadavers Proper assembly of the cystoscope, proper setup of additional cystoscopy equipment (distension medium, tubing, camera and light source), performing a series of predetermined bladder and urethra survey tasks, including identification of abnormalities. 29 obstetrician– gynecologists 2-hour didactic session OSATS, GRS 1B - - Y - - - Y Schout 2010 2 Uro Mentor Real-time cystourethroscopy 30 experts, 50 novices GRS 3B - - - - - Y - Dolmans 2009 3 Uro Mentor 56 urologists 33 residents - Y - Y - Y - Uro Mentor Evaluation questionnair e about the tasks OSATS 3B Gettman 2009 4 4 - Y - - Y - Schout 2009 5 Uro Mentor Urethrocystoscopy task (bladder inspection, biopsy, and coagulation) or a ureterorenoscopy task (manipulation of a distal ureter stone) Task 1 involved a rigid cystoscope, and placement of a guide wire through the ureteral orifice and into the ureter. Task 2 involved a flexible cystoscope for performing diagnostic cystoscopy. Task 3 involved a rigid cystoscope to identify a bladder lesion. Training, handling of scope Training, systematic bladder inspection and 15-min instruction video 15-min introduction session - GRS 1B - Y - - Y - 10 novice 45 min per sessions 50 trained 50 untrained 15-min instruction Reliability Evaluation scoring Content validity Training duration Construct validity Level of participants Face validity Training tasks Oxford level of evidence Feasibility Trade name of the model Educational impact Table 3: An overview of studies using various types of simulation models for cystoscopy training and assessment forward planning Training, speed and flow of procedure residents Task 1 involved a rigid cystoscope, and placement of a guide wire through the ureteral orifice and into the ureter. Task2 involved a flexible cystoscope for performing diagnostic cystoscopy. Task 3 involved a rigid cystoscope to identify a bladder lesion. Cystoscopy, guide wire insertion, semirigid ureteroscopy and basket extraction of a distal ureteric stone 30 novice, 27 experts All subjects performed 5 trials of 3 basic cystoscopic tasks. OSATS 3B 8 senior residents, 8 junior residents 10 novice, 21 expert 3 days GRS 3B - OSATS 3B 2 supervised training sessions of 60 minutes each with an interval of 1 week Exercise performed 3 times before assessment 6.5 hours Total procedure time & relative blood loss 3B Gettman 2008 6 Uro Mentor Matsumot o 2006 7 Uro Mentor Dolmans 2006 8 Uro Mentor Cystoscopy task with biopsy taking and coagulation of the biopsy site Reich 2006 9 Uro Trainer Cystoscopy and resection of bladder tumors 24 medical students, 12 residents Manyak 2002 10 - Endoscopy of the lower urinary tract traversing the male urethra across the prostate and into the urinary bladder 8 urology residents Shah 2002 Uro Mentor course Flexible cystoscopy 14 urology nurse practitioners 11 17 question written evaluation - Y Y - - - Y Y - Y - Y - - - - - - Y - - - - - Y - - - Y - - Y Y - - 4 Y Shah, 2002 12 Uro Mentor Flexible cystoscopy 10 novices, 7 experts - Total time, number of flags visualised Wilhelm 2002 13 Uro Mentor Rigid cystoscopy, flexible ureteroscopy with laser lithotripsy, and basket retrieval of a proximal ureteral stone 21 medical students Five 30 minute supervised training sessions GRS 2B - - Y - - - - - - Y - - - - Table 4: An overview of studies using various types of simulation models for ureteroscopy training and assessment URETERORENOSCOPY - GRS and time to task completion. Chou 2006 Uro Mentor Cystoscopy: access the ureter with a guide wire, insert the flexible ureteroscope, identify the ureteral stone, perform laser lithotripsy, basket extract the stone, and remove the ureteroscope. Urethrocystoscopic task (bladder inspection, biopsy and coagulation) or a ureterorenoscopic task (stone manipulation of a distal ureter stone). Check patient identity, position the patient, enter the bladder with cystoscope, check the bladder, find the orifices, place guide wire, enter the bladder with ureteroscope, enter the orifice, advance the 46 attending urologists, urology residents, medical students and industry representatives 16 medical students 2 months 70 urologists 26 urology residents 15 Schout 2006 16 Uro Mentor Brehmer 2005 17 Mediskills Cost- effectiveness Flexible ureteroscopy, renoscopy and intrarenal basket extraction of a lower pole calculus Educational impact Adult ureteroscopy trainer (Ideal Anatomic Modelling) Reliability White 2010 14 Content validity Evaluation scoring Construct validity Training duration Face validity Level of participants Feasibility Training tasks Oxford level of evidence Trade name of the model 3B - Y Y Y - - - OSATS 4 - - - Y - - - - Total procedure time 4 - Y - - - - - First two day 8 hrs Next two days 2x8 hrs OSATS 4 - - Y Y Y Y - ureteroscope in the ureter and empty the bladder. Knoll 2005 Uro Mentor Rigid and flexible ureterorenoscopy treating a lower calyceal stone, 20 experts, 5 novice 20 min session Johnson 2004 19 Uro Mentor Ureteroscopy and laser lithotripsy 18 medical students, 13 medical students 10 days for 30 minutes daily prior to evaluation. Ogan 2004 Uro Mentor Rigid cystoscopy, passage of a guide wire and flexible ureteroscope (URS) inspection of all calices and removal of the ureteroscope. Rigid cystoscopy, ureteral orifice cannulation with a Bentson wire, flexible ureteroscopy and systematic inspection of the collecting system 16 medical students 16 residents 5 hours of supervised training on the simulator 16 medical students 16 residents 5 hours during a 2-week period 18 20 Jacomides 2004 21 Uro Mentor Total operation time, X-ray exposure, Guide wire insertion time ,time of progression from the orifice to the stone, stone contact time, number of perforations, bleeding Scored by 2 independent expert reviewers using a modified Global Rating Operative Performance Scale (GROPS) GRS 3B - Y Y Y - Y Y 3B - - - - - Y - 3B - - Y - - Y - OSATS 3B - - Y - - - - Matsumot2 002 22 Bench model Cystoscopy phase with guide wire insertion and the ureteroscopy phase with stone basket extraction. 40 medical students 1 hour GRS 4 Watterson 2002 23 Uro Mentor Ureteroscopy 20 novice trainees - GRS 4 Brehmer 2002 24 Mediskills bench model Check patient identity, position the patient, enter the bladder with cystoscope, check the bladder, find the orifices, place guide wire, enter the bladder with ureteroscope, enter the orifice, advance the ureteroscope in the ureter and empty the bladder. 9 consultants 5 trainees - OSATS 3B Matsumot 2001 25 Limbs and Things Cystoscopy and guide wire insertion, and ureteroscopy and basket extraction of a stone. 17 urology residents 1 hour Ureteroscopic global scale 4 - - - - Y Y - Y Y Y - - - - - Y Y - - - - Y - Y - - Training duration Evaluation scoring Feasibility Face validity Educational impact Cost- effectiveness Kallstrom 2010 26 TURP simulator (PelvicVision) Transurethral resection of prostate 11 medical students, 9 experienced urologists Procedure checklist 3B - - Y - - - - Schout 2009 27 Uro Trainer Transurethral bladder tumor resection and/or transurethral prostate resection 104 urologists and urology residents Students received a short lecture on benign prostatic enlargement and the procedure of TURP - 4 - Y - Y - - - Rashid 2007 28 TURP (Transure thral resection of the prostate) simulator Transurethral resection of prostate 72 urologists, 45 residents and 19 novices - Rated simulator usefulness and realism on a 10point scale (1—not at all useful/realistic/poor, 10—very useful/realistic/excel lent) Grams resected, blood loss, irrigant volume used, foot pedal use and differential time spent with orientation, cutting or coagulation. 3B - - Y - - - - Kallstrom TURP Transurethral resection of 17 experienced - 3B - Y Y Y - - - Reliability Level of participants Content validity Training tasks Construct validity Trade name of the model Oxford level of evidence Table 5: An overview of studies using various types of simulation models for TURP/TURBT training and assessment TURP/TURBT 29 VR simulator prostate Sweet 2004 30 TURP (Transure thral resection of the prostate) simulator Transurethral resection of prostate Kumar 2002 31 Latex polymer prostate model in a perspex box TURP simulator Transurethral resection of prostate 1 urological trainee, 1 consultant urologist Transurethral resection of prostate 3 urologists 2005 Ballaro 1999 32 urologists for face validity and 9 experienced urologists for content validit, 7 students for construct validity 72 urologists &19 novice 5-minute resection task 3B - Y Y Y - - - - Capsular perforation, external sphincter resection, rectal perforation, dorsal venous complex resection, ureteral orifice resection and undermining of the bladder neck - 3B - - - - - - - - - 3B - - - Y - - TURP/TURBT: Transurethral resection of prostate/Transurethral resection of bladder tumour Percutaneous renal access novices (15) and experts (9) 2x 30-minute sessions Stern 2007 Percutaneous nephrolithotomy Review Knudsen 2006 35 Porcine kidney & bladder PERC Mentor Total time (seconds) X-ray exposure time (seconds Total time spent introducing needle to collecting system (seconds) Number of attempts to puncture the collecting system Perforations (number of occurrences) Total amount of retrograde contrast injected (mL) GRS Consisting of percutaneous renal puncture followed by the introduction of a guide wire into the collecting system Hammond 2004 36 Porcine kidneys Needle access, tract dilation and renal access sheath insertion using fluoroscopy. 63 trainees: 31 2x 30-minute medical sessions students, 31 residents and 1 fellow Not stated - 34 Cost- effectiveness PERC Mentor Modified endourological GRS 3B - Y Y Y - - - - 4 - Y - - - - - 2B Y 3A Reliability Mishra 2010 33 Content validity Evaluation scoring Construct validity Training duration Face validity Level of participants Feasibility Training tasks Oxford level of evidence Trade name of the model Educational impact Table 6: An overview of studies using various types of simulation models for percutaneous renal access PERCUTANEOUS RENAL ACCESS Y Y Y Y Y Mishra 2002 37 Uro Mentor Ureterorenoscopy and percutaneous nephrolitholapaxy None, evaluation of Uro Mentor - - 5 - - - - - Y Y Table 7: An overview of studies using various types of simulation models for laparoscopic nephrectomy training and assessment 39 Traxer 2001 40 8 expert urological laparoscopic surgeons 10 residents and 10 novices 2 sessions Time Haemorrhage Tool travel Total errors 4 - Y Y Dissecting the renal hilum via the retroperitoneal 21 medical students - Time, blood loss, path length, and total score 2B - Y Y Y - - Laparoscopic nephrectomy 12 urology residents 30 minutes daily for 10 days. OSATS 4 - - - Y Y Y - Cost- effectiveness Dissection and division of the ureter; Dissection of hilum and division of hilar vessels; Dissection of kidney from peritoneum Educational impact Procedicus MIST (Minimally invasive surgical trainer) Nephrectomy simulator LN (Laparoscopi c nephrectomy )-VR (Virtual reality) simulator (Guy’sMentice) Porcine laparoscopic nephrectomy Reliability Evaluation scoring Content validity Training duration Construct validity Level of participants Face validity Wijn 2010 Training tasks Feasibility Brewin 2010 38 Trade name of the model Oxford level of evidence LAPAROSCOPIC NEPHRECTOMY - - - Table 8: An overview of studies using various types of simulation models for vasovasotomy training and assessment 50 junior residents 1 day OSATS 2B - - - - Y Y Cost- effectiveness Vasovasostomy Educational impact Silicone tubing or live rat vas deferens Reliability Evaluation scoring Content validity Training duration Construct validity Level of participants Face validity Training tasks Feasibility Grober 2004 41 Trade name of the model Oxford level of evidence VASOVASOTOMY - REFERENCES: 1. Bowling, C. B., Greer, W. J., Bryant, S. A. et al.: Testing and validation of a low-cost cystoscopy teaching model: a randomized controlled trial. Obstet Gynecol, 116: 85, 2010 2. Schout, B. M., Muijtjens, A. M., Hendrikx, A. J. et al.: Acquisition of flexible cystoscopy skills on a virtual reality simulator by experts and novices. BJU Int, 105: 234, 2010 3. Dolmans, V. E., Schout, B. M., de Beer, N. A. et al.: The virtual reality endourologic simulator is realistic and useful for educational purposes. J Endourol, 23: 1175, 2009 4. Gettman, M. T., Le, C. Q., Rangel, L. J. et al.: Development of a standardized curriculum for teaching cystoscopic skills using a computerbased endourologic simulator. Simul Healthc, 4: 92, 2009 5. Schout, B. M., Ananias, H. J., Bemelmans, B. L. et al.: Transfer of cysto-urethroscopy skills from a virtual-reality simulator to the operating room: a randomized controlled trial. BJU Int, 2009 6. Gettman, M. T., Le, C. Q., Rangel, L. J. et al.: Analysis of a computer based simulator as an educational tool for cystoscopy: subjective and objective results. J Urol, 179: 267, 2008 7. Matsumoto, E. D., Pace, K. T., RJ, D. A. H.: Virtual reality ureteroscopy simulator as a valid tool for assessing endourological skills. Int J Urol, 13: 896, 2006 8. V.E.M.G. Dolmans, B. M. A. S., N.A.M. de Beer, A.J.M. Hendrikx Catharina Hospital, Eindhoven, T. N.: Determination of construct validity of the URO Mentor, a virtual reality simulator for endourological procedures. Simul Healthc, 1, 2006 9. Reich, O., Noll, M., Gratzke, C. et al.: High-level virtual reality simulator for endourologic procedures of lower urinary tract. Urology, 67: 1144, 2006 10. Manyak, M. J., Santangelo, K., Hahn, J. et al.: Virtual reality surgical simulation for lower urinary tract endoscopy and procedures. J Endourol, 16: 185, 2002 11. Shah, J., Montgomery, B., Langley, S. et al.: Validation of a flexible cystoscopy course. BJU Int, 90: 833, 2002 12. Shah, J., Darzi, A.: Virtual reality flexible cystoscopy: a validation study. BJU Int, 90: 828, 2002 13. Wilhelm, D. M., Ogan, K., Roehrborn, C. G. et al.: Assessment of basic endoscopic performance using a virtual reality simulator. J Am Coll Surg, 195: 675, 2002 14. 2010 White, M. A., Dehaan, A. P., Stephens, D. D. et al.: Validation of a high fidelity adult ureteroscopy and renoscopy simulator. J Urol, 183: 673, 15. Chou, D. S., Abdelshehid, C., Clayman, R. V. et al.: Comparison of results of virtual-reality simulator and training model for basic ureteroscopy training. J Endourol, 20: 266, 2006 16. Schout B.M.A., D. V. E. M. G., De Beer N.A.M., Hendrikx A.J.M. Catharina Hospital Eindhoven, The Netherlands: The virtual reality simulator the URO Mentor is a realistic and valid training model: determination of face validity. Simul Healthc, 1, 2006 17. Brehmer, M., Swartz, R.: Training on bench models improves dexterity in ureteroscopy. Eur Urol, 48: 458, 2005 18. Knoll, T., Trojan, L., Haecker, A. et al.: Validation of computer-based training in ureterorenoscopy. BJU Int, 95: 1276, 2005 19. Johnson, D. B., Kondraske, G. V., Wilhelm, D. M. et al.: Assessment of basic human performance resources predicts the performance of virtual ureterorenoscopy. J Urol, 171: 80, 2004 20. Ogan, K., Jacomides, L., Shulman, M. J. et al.: Virtual ureteroscopy predicts ureteroscopic proficiency of medical students on a cadaver. J Urol, 172: 667, 2004 21. Jacomides, L., Ogan, K., Cadeddu, J. A. et al.: Use of a virtual reality simulator for ureteroscopy training. J Urol, 171: 320, 2004 22. Matsumoto, E. D., Hamstra, S. J., Radomski, S. B. et al.: The effect of bench model fidelity on endourological skills: a randomized controlled study. J Urol, 167: 1243, 2002 23. Watterson, J. D., Beiko, D. T., Kuan, J. K. et al.: Randomized prospective blinded study validating acquistion of ureteroscopy skills using computer based virtual reality endourological simulator. J Urol, 168: 1928, 2002 24. Brehmer, M., Tolley, D.: Validation of a bench model for endoscopic surgery in the upper urinary tract. Eur Urol, 42: 175, 2002 25. Matsumoto, E. D., Hamstra, S. J., Radomski, S. B. et al.: A novel approach to endourological training: training at the Surgical Skills Center. J Urol, 166: 1261, 2001 26. Kallstrom, R., Hjertberg, H., Svanvik, J.: Construct validity of a full procedure, virtual reality, real-time, simulation model for training in transurethral resection of the prostate. J Endourol, 24: 109, 2010 27. Schout, B. M., Bemelmans, B. L., Martens, E. J. et al.: How useful and realistic is the uro trainer for training transurethral prostate and bladder tumor resection procedures? J Urol, 181: 1297, 2009 28. Rashid, H. H., Kowalewski, T., Oppenheimer, P. et al.: The virtual reality transurethral prostatic resection trainer: evaluation of discriminate validity. J Urol, 177: 2283, 2007 29. Kallstrom, R., Hjertberg, H., Kjolhede, H. et al.: Use of a virtual reality, real-time, simulation model for the training of urologists in transurethral resection of the prostate. Scand J Urol Nephrol, 39: 313, 2005 30. Sweet, R., Kowalewski, T., Oppenheimer, P. et al.: Face, content and construct validity of the University of Washington virtual reality transurethral prostate resection trainer. J Urol, 172: 1953, 2004 31. Kumar, P. V., Gomes, M. P., Davies, B. L. et al.: A computer assisted surgical trainer for transurethral resection of the prostate. J Urol, 168: 2111, 2002 32. Ballaro, A., Briggs, T., Garcia-Montes, F. et al.: A computer generated interactive transurethral prostatic resection simulator. J Urol, 162: 1633, 1999 33. Mishra, S., Kurien, A., Patel, R. et al.: Validation of virtual reality simulation for percutaneous renal access training. J Endourol, 24: 635, 2010 34. Stern, J., Zeltser, I. S., Pearle, M. S.: Percutaneous renal access simulators. J Endourol, 21: 270, 2007 35. Knudsen, B. E., Matsumoto, E. D., Chew, B. H. et al.: A randomized, controlled, prospective study validating the acquisition of percutaneous renal collecting system access skills using a computer based hybrid virtual reality surgical simulator: phase I. J Urol, 176: 2173, 2006 36. Hammond, L., Ketchum, J., Schwartz, B. F.: A new approach to urology training: a laboratory model for percutaneous nephrolithotomy. J Urol, 172: 1950, 2004 37. Michel, M. S., Knoll, T., Kohrmann, K. U. et al.: The URO Mentor: development and evaluation of a new computer-based interactive training system for virtual life-like simulation of diagnostic and therapeutic endourological procedures. BJU Int, 89: 174, 2002 38. Brewin, J., Nedas, T., Challacombe, B. et al.: Face, content and construct validation of the first virtual reality laparoscopic nephrectomy simulator. BJU Int, 2010 39. Wijn, R. P., Persoon, M. C., Schout, B. M. et al.: Virtual reality laparoscopic nephrectomy simulator is lacking in construct validity. J Endourol, 24: 117, 2010 40. Traxer, O., Gettman, M. T., Napper, C. A. et al.: The impact of intense laparoscopic skills training on the operative performance of urology residents. J Urol, 166: 1658, 2001 41. Grober, E. D., Hamstra, S. J., Wanzel, K. R. et al.: Laboratory based training in urological microsurgery with bench model simulators: a randomized controlled trial evaluating the durability of technical skill. J Urol, 172: 378, 2004