초록접수 현황
| 17F-140 | 구연 미채택시 포럼 발표 |
Augmented Reality Smart Goggle for Intraoperative Fluorescence Image-guided Navigation Surgery
Hyun Koo Kim¹, Ki Hyeok Kwon², Yu Hua Quan², Jung Suk Heo², Kanghoon Lee¹, Kook Nam Han¹, Young Ho Choi¹, Beop-Min Kim²
¹Department of Thoracic and Cardiovascular Surgery, Korea University Guro Hospital, Korea University College of Medicine, Seoul, Republic of Korea., ²Department of Interdisciplinary Bio/Micro System Technology, Korea University College of Engineering, Seoul, Republic of Korea
Purpose : The near-infrared (NIR) fluorescence imaging can provide guidance during various surgical procedures. We introduce a new type of guidance system that provides fluorescence images superimposed on clinician’s own vision using an augmented reality type smart goggle.
Methods : The fluorescence images are collected using a separate NIR-camera. Through the prism display, the fluorescence image is continuously overlaid on top of the perceived object image while adjusting for object distance and angle changes (Fig. 1). We used a three point pattern matching method to solve the mismatch problem of image superimposition. We conducted matching processing and transmission speed test. Mouse and rabbit cancer model studies were conducted to verify the efficacy of our system.
Results : On average, transmission rates of 7.25 fps and processing time of 2.02±0.75 sec were measured by ten trials. The fluorescence image of indocyanine green (ICG) injection site and the lymphatic images was successfully transferred to the smart goggle system. Under the smart goggle system guidance, we removed the lymph node from mouse and rabbit cancer model clearly. The mean signal to background ratio was obtained as 3.3±0.63 through twenty trials image analysis for each mouse (N1=2.6±0.21, N2=3.4±0.30, N3=4.0±0.27).
Conclusion : Our system provided sufficient information of lymphatic images by NIR fluorescence signal during surgical procedure and lymph nodes were successfully detected in ICG injected mouse and rabbit cancer model. This study demonstrates see-through type smart goggle system which augmented reality based fluorescence image has the potential to the more surgeon-friendly application of NIR fluorescence image guided surgery.
Methods : The fluorescence images are collected using a separate NIR-camera. Through the prism display, the fluorescence image is continuously overlaid on top of the perceived object image while adjusting for object distance and angle changes (Fig. 1). We used a three point pattern matching method to solve the mismatch problem of image superimposition. We conducted matching processing and transmission speed test. Mouse and rabbit cancer model studies were conducted to verify the efficacy of our system.
Results : On average, transmission rates of 7.25 fps and processing time of 2.02±0.75 sec were measured by ten trials. The fluorescence image of indocyanine green (ICG) injection site and the lymphatic images was successfully transferred to the smart goggle system. Under the smart goggle system guidance, we removed the lymph node from mouse and rabbit cancer model clearly. The mean signal to background ratio was obtained as 3.3±0.63 through twenty trials image analysis for each mouse (N1=2.6±0.21, N2=3.4±0.30, N3=4.0±0.27).
Conclusion : Our system provided sufficient information of lymphatic images by NIR fluorescence signal during surgical procedure and lymph nodes were successfully detected in ICG injected mouse and rabbit cancer model. This study demonstrates see-through type smart goggle system which augmented reality based fluorescence image has the potential to the more surgeon-friendly application of NIR fluorescence image guided surgery.
책임저자: Hyun Koo Kim
Department of Thoracic and Cardiovascular Surgery, Korea University Guro Hospital, Korea University College of Medicine, Seoul, Republic of Korea
발표자: Hyun Koo Kim, E-mail : kimhyunkoo@korea.ac.kr