IO-2  3D Virtual Simulator for Urology (Hu-Mo Simulator)

Specification: Urology 3D virtual simulator

Aims: Medical simulation techniques are going to be a part of mandatory process for training education. Enhancing and improving the quality of medical high-resolution images, three-dimensional (3D) visualization becomes possible and students' understanding can be improved in clinical practice and education. We aim extraction and reconstruction of 3D realistic anatomical models from CT/DICOM images with variable software packages and simulating them three dimensionally for educational purposes

Benefits:  

  • Decrease the cost with using virtual based 3D models for surgical implementation and simulation, learning anatomy in medical fields specifically on urology, no more expensive machines and simulators

  • Using simulation technology for better understanding 3D surgical anatomy 

  • Creating 3D medical simulator for virtual training (in laparoscopic/endoscopic)

  • Virtual training curriculum on medical models will be one of the target at the end of the Project

  • Medical 3D virtual reality technique is easily applicable to other clinic area.

  • The main advantage of  3D simulator, unlike in-vivo training, the entire procedure is completed in a risk-free environment without space-time constraints.

 

Methodology:  Medical 3D simulation technology has resulted in exciting new solutions and possibilities of medical diagnosis and practice. The first step in developing a Medical 3D simulation is to reconstruct a DICOM file standardized with medical images from software package MIMICS, and to extract appropriate anatomical 3D model information such as STL. The second step to create a realistic human model is customizing the STL data with 3DS MAX and Z-Brush 3D model editing tool and texturing process using Photoshop to express realistic anatomical texture. The third step to visualization in virtual reality, a refined human 3D data is put into a virtual reality engine such as Unity 3D, and the simulator is completed through customization process like as program coding and interface device interlocking process.

 

 

Workflow:

 

  • Medical Image (CT/MRI) : Extraction of  Computer Tomography (CT ) or Magnetic Resonance Imaging (MRI) data, from patients or cadavers with medical image device.

  • Dicom : Generating the Digital Imaging and Communications in Medicine (DICOM) files from CT/MRI with Mimics.

  • Segmentation : Mask the area of interest  and extracting STL files with Mimics.

  • Modeling : 3D Surface treatment and texturing for realistic human & surgery tool model with 3DS MAX and Z-Brush

  • Library : 3D animated surgical movements with 3D controller and Building libraries of final 3D data  with 3DS MAX and Z-Brush

  • Coding : Converting 3D data into VR engine and  component Coding with Unity 3D

  • Simulator: Application publishing with Unity 3D

Figure 1: Generating a medical 3D simulator

MedTRain3DModsim Urology 3D Simulator

European Board of Urology suggested 14 urologic procedures that need to make an assessment for evaluation resident’s skills. We selected 3 type urologic procedures that were included to the list of  EBU to make 3D simulators as training purposes

1th Type : Standard Cystoscopy (flexible/rigid) simulator

<https://en.wikipedia.org/wiki/Cystoscopy#Blue_light_cystoscopy>

2nd Type: Standard Retrograde Intrarenal Exploration (inspection of pelvicaliciel system/ relocation of stone with basket) simulator

<http://advinurology.blogspot.kr/2015/07/ur-eteroscopy-is-where-long-thin-rigid.html>

3rd Type: Standard Laparoscopic Exploration for Nephrectomy (partial/total) simulator

<https://en.wikipedia.org/wiki/Nephrectomy>