Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics
Background: In neurosurgery, it is important to inspect the spatial correspondence between the preoperative medical image (virtual space), and the intraoperative findings (real space) to improve the safety of the surgery. Navigation systems and related modalities have been reported as methods for ma...
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2021-07-01
|
| Series: | World Neurosurgery: X |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2590139721000053 |
| _version_ | 1819103081958211584 |
|---|---|
| author | Tsukasa Koike Taichi Kin Shota Tanaka Yasuhiro Takeda Hiroki Uchikawa Taketo Shiode Toki Saito Hirokazu Takami Shunsaku Takayanagi Akitake Mukasa Hiroshi Oyama Nobuhito Saito |
| author_facet | Tsukasa Koike Taichi Kin Shota Tanaka Yasuhiro Takeda Hiroki Uchikawa Taketo Shiode Toki Saito Hirokazu Takami Shunsaku Takayanagi Akitake Mukasa Hiroshi Oyama Nobuhito Saito |
| author_sort | Tsukasa Koike |
| collection | DOAJ |
| description | Background: In neurosurgery, it is important to inspect the spatial correspondence between the preoperative medical image (virtual space), and the intraoperative findings (real space) to improve the safety of the surgery. Navigation systems and related modalities have been reported as methods for matching this correspondence. However, because of the influence of the brain shift accompanying craniotomy, registration accuracy is reduced. In the present study, to overcome these issues, we developed a spatially accurate registration method of medical fusion 3-dimensional computer graphics and the intraoperative brain surface photograph, and its registration accuracy was measured. Methods: The subjects included 16 patients with glioma. Nonrigid registration using the landmarks and thin-plate spline methods was performed for the fusion 3-dimensional computer graphics and the intraoperative brain surface photograph, termed mixed-reality computer graphics. Regarding the registration accuracy measurement, the target registration error was measured by two neurosurgeons, with 10 points for each case at the midpoint of the landmarks. Results: The number of target registration error measurement points was 160 in the 16 cases. The target registration error was 0.72 ± 0.04 mm. Aligning the intraoperative brain surface photograph and the fusion 3-dimensional computer graphics required ∼10 minutes on average. The average number of landmarks used for alignment was 24.6. Conclusions: Mixed-reality computer graphics enabled highly precise spatial alignment between the real space and virtual space. Mixed-reality computer graphics have the potential to improve the safety of the surgery by allowing complementary observation of brain surface photographs and fusion 3-dimensional computer graphics. |
| first_indexed | 2024-12-22T01:44:48Z |
| format | Article |
| id | doaj.art-310da6f7d98a4494a208767a0f2e9d61 |
| institution | Directory Open Access Journal |
| issn | 2590-1397 |
| language | English |
| last_indexed | 2024-12-22T01:44:48Z |
| publishDate | 2021-07-01 |
| publisher | Elsevier |
| record_format | Article |
| series | World Neurosurgery: X |
| spelling | doaj.art-310da6f7d98a4494a208767a0f2e9d612022-12-21T18:43:06ZengElsevierWorld Neurosurgery: X2590-13972021-07-0111100102Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer GraphicsTsukasa Koike0Taichi Kin1Shota Tanaka2Yasuhiro Takeda3Hiroki Uchikawa4Taketo Shiode5Toki Saito6Hirokazu Takami7Shunsaku Takayanagi8Akitake Mukasa9Hiroshi Oyama10Nobuhito Saito11Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan; To whom correspondence should be addressed: Taichi Kin, M.D.Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Clinical Information Engineering, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medical Sciences, Kumamoto University, Kumamoto, JapanDepartment of Clinical Information Engineering, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanBackground: In neurosurgery, it is important to inspect the spatial correspondence between the preoperative medical image (virtual space), and the intraoperative findings (real space) to improve the safety of the surgery. Navigation systems and related modalities have been reported as methods for matching this correspondence. However, because of the influence of the brain shift accompanying craniotomy, registration accuracy is reduced. In the present study, to overcome these issues, we developed a spatially accurate registration method of medical fusion 3-dimensional computer graphics and the intraoperative brain surface photograph, and its registration accuracy was measured. Methods: The subjects included 16 patients with glioma. Nonrigid registration using the landmarks and thin-plate spline methods was performed for the fusion 3-dimensional computer graphics and the intraoperative brain surface photograph, termed mixed-reality computer graphics. Regarding the registration accuracy measurement, the target registration error was measured by two neurosurgeons, with 10 points for each case at the midpoint of the landmarks. Results: The number of target registration error measurement points was 160 in the 16 cases. The target registration error was 0.72 ± 0.04 mm. Aligning the intraoperative brain surface photograph and the fusion 3-dimensional computer graphics required ∼10 minutes on average. The average number of landmarks used for alignment was 24.6. Conclusions: Mixed-reality computer graphics enabled highly precise spatial alignment between the real space and virtual space. Mixed-reality computer graphics have the potential to improve the safety of the surgery by allowing complementary observation of brain surface photographs and fusion 3-dimensional computer graphics.http://www.sciencedirect.com/science/article/pii/S2590139721000053Brain shiftComputer graphicsGliomaLandmarkMixed-realityTarget registration error |
| spellingShingle | Tsukasa Koike Taichi Kin Shota Tanaka Yasuhiro Takeda Hiroki Uchikawa Taketo Shiode Toki Saito Hirokazu Takami Shunsaku Takayanagi Akitake Mukasa Hiroshi Oyama Nobuhito Saito Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics World Neurosurgery: X Brain shift Computer graphics Glioma Landmark Mixed-reality Target registration error |
| title | Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics |
| title_full | Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics |
| title_fullStr | Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics |
| title_full_unstemmed | Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics |
| title_short | Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics |
| title_sort | development of innovative neurosurgical operation support method using mixed reality computer graphics |
| topic | Brain shift Computer graphics Glioma Landmark Mixed-reality Target registration error |
| url | http://www.sciencedirect.com/science/article/pii/S2590139721000053 |
| work_keys_str_mv | AT tsukasakoike developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT taichikin developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT shotatanaka developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT yasuhirotakeda developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT hirokiuchikawa developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT taketoshiode developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT tokisaito developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT hirokazutakami developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT shunsakutakayanagi developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT akitakemukasa developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT hiroshioyama developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics AT nobuhitosaito developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics |