A Fast and Robust Framework for 3D/2D Model to Multi-Frame Fluoroscopy Registration

Three-dimensional (3D) kinematic analysis plays an important role in improving diagnosis and in the evaluation of treatments and surgical procedures. For example, measuring the 3D kinematics of knee joints is essential for understanding their normal function and diagnosing any pathology, such as lig...

Full description

Bibliographic Details
Main Authors: Shabnam Saadat, Md. Asikuzzaman, Mark R. Pickering, Diana M. Perriman, Jennie M. Scarvell, Paul N. Smith
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9543686/
_version_ 1818738403680714752
author Shabnam Saadat
Md. Asikuzzaman
Mark R. Pickering
Diana M. Perriman
Jennie M. Scarvell
Paul N. Smith
author_facet Shabnam Saadat
Md. Asikuzzaman
Mark R. Pickering
Diana M. Perriman
Jennie M. Scarvell
Paul N. Smith
author_sort Shabnam Saadat
collection DOAJ
description Three-dimensional (3D) kinematic analysis plays an important role in improving diagnosis and in the evaluation of treatments and surgical procedures. For example, measuring the 3D kinematics of knee joints is essential for understanding their normal function and diagnosing any pathology, such as ligament injury and osteoarthritis. Image registration is a method which can be used to compute kinematic measurements without involving the introduction of instruments into the body. However, in these techniques, the trade-off between accuracy and computation time is still a challenging problem which needs to be addressed. In this paper, a fast and robust registration method is proposed for the measurement of post-operative knee joint kinematics. Using this method, after total knee arthroplasty (TKA) surgery, a 3D knee implant model can be registered with a number of single-plane fluoroscopy frames of the patients’ knee. Generally, when the number of fluoroscopy frames is quite high, the computation cost for the registration between the frames and a 3D model is expensive. Therefore, in order to speed up the registration process, we apply an interpolation-based prediction method, to initialize and estimate the 3D positions of the 3D model in each fluoroscopy frame. The estimated 3D positions are then fine-tuned. The experimental results, which were performed on the knee joints of 18 patients post-surgery, show that the computational time required to register each frame for each bone using our proposed method is only 67 seconds, which is much faster (almost 6.5 times faster) than the best existing registration method (a registration method based on sum of conditional variance (SCV) similarity measure) while maintaining almost the same accuracy. The average of the mean difference ± standard deviation of the proposed method for femoral and tibial bones for translation and rotation parameters are 0.0603 ± 0.2966 (mm) and −0.0069 ± 0.2922 (degree) respectively.
first_indexed 2024-12-18T01:08:23Z
format Article
id doaj.art-ebcad6090f2d4490a8133740bc152127
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-18T01:08:23Z
publishDate 2021-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-ebcad6090f2d4490a8133740bc1521272022-12-21T21:26:10ZengIEEEIEEE Access2169-35362021-01-01913422313423910.1109/ACCESS.2021.31143669543686A Fast and Robust Framework for 3D/2D Model to Multi-Frame Fluoroscopy RegistrationShabnam Saadat0https://orcid.org/0000-0002-5632-312XMd. Asikuzzaman1https://orcid.org/0000-0003-2079-009XMark R. Pickering2https://orcid.org/0000-0001-6736-3859Diana M. Perriman3Jennie M. Scarvell4https://orcid.org/0000-0003-3944-3071Paul N. Smith5School of Engineering and Information Technology, University of New South Wales, Canberra, ACT, AustraliaSchool of Engineering and Information Technology, University of New South Wales, Canberra, ACT, AustraliaSchool of Engineering and Information Technology, University of New South Wales, Canberra, ACT, AustraliaTrauma and Orthopaedic Research Unit, Canberra Hospital, Canberra, ACT, AustraliaFaculty of Health, University of Canberra, Canberra, ACT, AustraliaMedical School, Australian National University, Canberra, ACT, AustraliaThree-dimensional (3D) kinematic analysis plays an important role in improving diagnosis and in the evaluation of treatments and surgical procedures. For example, measuring the 3D kinematics of knee joints is essential for understanding their normal function and diagnosing any pathology, such as ligament injury and osteoarthritis. Image registration is a method which can be used to compute kinematic measurements without involving the introduction of instruments into the body. However, in these techniques, the trade-off between accuracy and computation time is still a challenging problem which needs to be addressed. In this paper, a fast and robust registration method is proposed for the measurement of post-operative knee joint kinematics. Using this method, after total knee arthroplasty (TKA) surgery, a 3D knee implant model can be registered with a number of single-plane fluoroscopy frames of the patients’ knee. Generally, when the number of fluoroscopy frames is quite high, the computation cost for the registration between the frames and a 3D model is expensive. Therefore, in order to speed up the registration process, we apply an interpolation-based prediction method, to initialize and estimate the 3D positions of the 3D model in each fluoroscopy frame. The estimated 3D positions are then fine-tuned. The experimental results, which were performed on the knee joints of 18 patients post-surgery, show that the computational time required to register each frame for each bone using our proposed method is only 67 seconds, which is much faster (almost 6.5 times faster) than the best existing registration method (a registration method based on sum of conditional variance (SCV) similarity measure) while maintaining almost the same accuracy. The average of the mean difference ± standard deviation of the proposed method for femoral and tibial bones for translation and rotation parameters are 0.0603 ± 0.2966 (mm) and −0.0069 ± 0.2922 (degree) respectively.https://ieeexplore.ieee.org/document/9543686/Cubic spline interpolationedge position differenceimage registrationmodel to multi-frame fluoroscopy registrationsimilarity measure
spellingShingle Shabnam Saadat
Md. Asikuzzaman
Mark R. Pickering
Diana M. Perriman
Jennie M. Scarvell
Paul N. Smith
A Fast and Robust Framework for 3D/2D Model to Multi-Frame Fluoroscopy Registration
IEEE Access
Cubic spline interpolation
edge position difference
image registration
model to multi-frame fluoroscopy registration
similarity measure
title A Fast and Robust Framework for 3D/2D Model to Multi-Frame Fluoroscopy Registration
title_full A Fast and Robust Framework for 3D/2D Model to Multi-Frame Fluoroscopy Registration
title_fullStr A Fast and Robust Framework for 3D/2D Model to Multi-Frame Fluoroscopy Registration
title_full_unstemmed A Fast and Robust Framework for 3D/2D Model to Multi-Frame Fluoroscopy Registration
title_short A Fast and Robust Framework for 3D/2D Model to Multi-Frame Fluoroscopy Registration
title_sort fast and robust framework for 3d 2d model to multi frame fluoroscopy registration
topic Cubic spline interpolation
edge position difference
image registration
model to multi-frame fluoroscopy registration
similarity measure
url https://ieeexplore.ieee.org/document/9543686/
work_keys_str_mv AT shabnamsaadat afastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT mdasikuzzaman afastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT markrpickering afastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT dianamperriman afastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT jenniemscarvell afastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT paulnsmith afastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT shabnamsaadat fastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT mdasikuzzaman fastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT markrpickering fastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT dianamperriman fastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT jenniemscarvell fastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration
AT paulnsmith fastandrobustframeworkfor3d2dmodeltomultiframefluoroscopyregistration