Study of Keypoints Detectors and Descriptors Performance on X-Ray Images Compared to the Visible Light Spectrum Images
In this work, we study the performance of wide-used keypoints detection and description algorithms: Scale-Invariant Feature Transform (SIFT), Speeded Up Robust Features (SURF), Oriented FAST and Rotated BRIEF (ORB), Binary Robust Invariant Scalable Keypoints(BRISK), Accelerated KAZE(AKAZE), which we...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9734049/ |
| _version_ | 1811309566420320256 |
|---|---|
| author | Mikhail Chekanov Oleg Shipitko Natalia Skoryukina |
| author_facet | Mikhail Chekanov Oleg Shipitko Natalia Skoryukina |
| author_sort | Mikhail Chekanov |
| collection | DOAJ |
| description | In this work, we study the performance of wide-used keypoints detection and description algorithms: Scale-Invariant Feature Transform (SIFT), Speeded Up Robust Features (SURF), Oriented FAST and Rotated BRIEF (ORB), Binary Robust Invariant Scalable Keypoints(BRISK), Accelerated KAZE(AKAZE), which were originally developed for images taken in visible light but widely applied in the fields where images are taken in a different spectrum. We compare the quality of algorithms and their robustness to various image transformations. The algorithms’ performance is tested on two image sets in the different spectra: digital X-Ray images and images taken in the visible spectrum. Each dataset captures complex scenes with many objects and partial occlusions. Geometrical transformations (rotation, shearing, scaling), linear color transformations, Gaussian blur are applied to the images. Then the detection and description algorithms are tested on the original and transformed images. The repeatability and number of corresponding points are calculated to assess detection algorithms. The ratio of correctly matched descriptors together with the ratio of the distances between the query descriptor, the nearest descriptor, and the second matched descriptor is computed to evaluate descriptors’ quality. The algorithms showed different behavior on different spectra. SURF demonstrated to be the best X-ray keypoint detector and for the visible spectrum, it shares first place with AKAZE detector. SIFT is the best descriptor in both spectra. The strong and weak points of each algorithm are discussed in the paper. |
| first_indexed | 2024-04-13T09:44:11Z |
| format | Article |
| id | doaj.art-d4504c0bd97448a3b6c852785dc14b60 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-13T09:44:11Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-d4504c0bd97448a3b6c852785dc14b602022-12-22T02:51:49ZengIEEEIEEE Access2169-35362022-01-0110389643897210.1109/ACCESS.2022.31596509734049Study of Keypoints Detectors and Descriptors Performance on X-Ray Images Compared to the Visible Light Spectrum ImagesMikhail Chekanov0Oleg Shipitko1https://orcid.org/0000-0003-1266-8828Natalia Skoryukina2Russian Academy of Sciences (RAS), Institute for Information Transmission Problems (IITP), Moscow, RussiaRussian Academy of Sciences (RAS), Institute for Information Transmission Problems (IITP), Moscow, RussiaFederal Research Center Computer Science and Control, Russian Academy of Sciences, Moscow, RussiaIn this work, we study the performance of wide-used keypoints detection and description algorithms: Scale-Invariant Feature Transform (SIFT), Speeded Up Robust Features (SURF), Oriented FAST and Rotated BRIEF (ORB), Binary Robust Invariant Scalable Keypoints(BRISK), Accelerated KAZE(AKAZE), which were originally developed for images taken in visible light but widely applied in the fields where images are taken in a different spectrum. We compare the quality of algorithms and their robustness to various image transformations. The algorithms’ performance is tested on two image sets in the different spectra: digital X-Ray images and images taken in the visible spectrum. Each dataset captures complex scenes with many objects and partial occlusions. Geometrical transformations (rotation, shearing, scaling), linear color transformations, Gaussian blur are applied to the images. Then the detection and description algorithms are tested on the original and transformed images. The repeatability and number of corresponding points are calculated to assess detection algorithms. The ratio of correctly matched descriptors together with the ratio of the distances between the query descriptor, the nearest descriptor, and the second matched descriptor is computed to evaluate descriptors’ quality. The algorithms showed different behavior on different spectra. SURF demonstrated to be the best X-ray keypoint detector and for the visible spectrum, it shares first place with AKAZE detector. SIFT is the best descriptor in both spectra. The strong and weak points of each algorithm are discussed in the paper.https://ieeexplore.ieee.org/document/9734049/Keypointsrepeatabilityrobustnessdigital X-ray imagescomputed tomographyCT |
| spellingShingle | Mikhail Chekanov Oleg Shipitko Natalia Skoryukina Study of Keypoints Detectors and Descriptors Performance on X-Ray Images Compared to the Visible Light Spectrum Images IEEE Access Keypoints repeatability robustness digital X-ray images computed tomography CT |
| title | Study of Keypoints Detectors and Descriptors Performance on X-Ray Images Compared to the Visible Light Spectrum Images |
| title_full | Study of Keypoints Detectors and Descriptors Performance on X-Ray Images Compared to the Visible Light Spectrum Images |
| title_fullStr | Study of Keypoints Detectors and Descriptors Performance on X-Ray Images Compared to the Visible Light Spectrum Images |
| title_full_unstemmed | Study of Keypoints Detectors and Descriptors Performance on X-Ray Images Compared to the Visible Light Spectrum Images |
| title_short | Study of Keypoints Detectors and Descriptors Performance on X-Ray Images Compared to the Visible Light Spectrum Images |
| title_sort | study of keypoints detectors and descriptors performance on x ray images compared to the visible light spectrum images |
| topic | Keypoints repeatability robustness digital X-ray images computed tomography CT |
| url | https://ieeexplore.ieee.org/document/9734049/ |
| work_keys_str_mv | AT mikhailchekanov studyofkeypointsdetectorsanddescriptorsperformanceonxrayimagescomparedtothevisiblelightspectrumimages AT olegshipitko studyofkeypointsdetectorsanddescriptorsperformanceonxrayimagescomparedtothevisiblelightspectrumimages AT nataliaskoryukina studyofkeypointsdetectorsanddescriptorsperformanceonxrayimagescomparedtothevisiblelightspectrumimages |