Thermal, Multispectral, and RGB Vision Systems Analysis for Victim Detection in SAR Robotics
Technological advancements have facilitated the development of sophisticated vision systems, integrating optical sensors with artificial vision and machine learning techniques to create applications in different fields of robotics. One such field is Search and Rescue (SAR) robotics, which has histor...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-01-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/14/2/766 |
| _version_ | 1827369845066301440 |
|---|---|
| author | Christyan Cruz Ulloa David Orbea Jaime del Cerro Antonio Barrientos |
| author_facet | Christyan Cruz Ulloa David Orbea Jaime del Cerro Antonio Barrientos |
| author_sort | Christyan Cruz Ulloa |
| collection | DOAJ |
| description | Technological advancements have facilitated the development of sophisticated vision systems, integrating optical sensors with artificial vision and machine learning techniques to create applications in different fields of robotics. One such field is Search and Rescue (SAR) robotics, which has historically played a significant role in assisting brigades following post-disaster events, particularly in exploration phases and, crucially, in victim identification. The importance of employing these systems in victim identification lies in their functionality under challenging conditions, enabling the capture of information across different light spectrum ranges (RGB, Thermal, Multispectral). This article proposes an innovative comparative analysis that scrutinizes the advantages and limitations of three sensor types in victim detection. It explores contemporary developments in the state-of-the-art and proposes new metrics addressing critical aspects, such as functionality in specific scenarios and the analysis of environmental disturbances. For the indoor and outdoor testing phase, a quadrupedal robot has been equipped with these cameras. The primary findings highlight the individual contributions of each sensor, particularly emphasizing the efficacy of the infrared spectrum for the thermal camera and the Near Infrared and Red Edge bands for the multispectral camera. Ultimately, following system evaluations, detection precisions exceeding 92% and 86%, respectively, were achieved. |
| first_indexed | 2024-03-08T09:58:29Z |
| format | Article |
| id | doaj.art-1bc71b24d5db4d488a7554b7853128a1 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-08T09:58:29Z |
| publishDate | 2024-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-1bc71b24d5db4d488a7554b7853128a12024-01-29T13:44:18ZengMDPI AGApplied Sciences2076-34172024-01-0114276610.3390/app14020766Thermal, Multispectral, and RGB Vision Systems Analysis for Victim Detection in SAR RoboticsChristyan Cruz Ulloa0David Orbea1Jaime del Cerro2Antonio Barrientos3Centro de Automática y Robótica (CSIC-UPM), Universidad Politécnica de Madrid—Consejo Superior de Investigaciones Científicas, 28006 Madrid, SpainCentro de Automática y Robótica (CSIC-UPM), Universidad Politécnica de Madrid—Consejo Superior de Investigaciones Científicas, 28006 Madrid, SpainCentro de Automática y Robótica (CSIC-UPM), Universidad Politécnica de Madrid—Consejo Superior de Investigaciones Científicas, 28006 Madrid, SpainCentro de Automática y Robótica (CSIC-UPM), Universidad Politécnica de Madrid—Consejo Superior de Investigaciones Científicas, 28006 Madrid, SpainTechnological advancements have facilitated the development of sophisticated vision systems, integrating optical sensors with artificial vision and machine learning techniques to create applications in different fields of robotics. One such field is Search and Rescue (SAR) robotics, which has historically played a significant role in assisting brigades following post-disaster events, particularly in exploration phases and, crucially, in victim identification. The importance of employing these systems in victim identification lies in their functionality under challenging conditions, enabling the capture of information across different light spectrum ranges (RGB, Thermal, Multispectral). This article proposes an innovative comparative analysis that scrutinizes the advantages and limitations of three sensor types in victim detection. It explores contemporary developments in the state-of-the-art and proposes new metrics addressing critical aspects, such as functionality in specific scenarios and the analysis of environmental disturbances. For the indoor and outdoor testing phase, a quadrupedal robot has been equipped with these cameras. The primary findings highlight the individual contributions of each sensor, particularly emphasizing the efficacy of the infrared spectrum for the thermal camera and the Near Infrared and Red Edge bands for the multispectral camera. Ultimately, following system evaluations, detection precisions exceeding 92% and 86%, respectively, were achieved.https://www.mdpi.com/2076-3417/14/2/766search and rescuevision sensorsthermal imagemultispectral imageRGB imagequadruped robot |
| spellingShingle | Christyan Cruz Ulloa David Orbea Jaime del Cerro Antonio Barrientos Thermal, Multispectral, and RGB Vision Systems Analysis for Victim Detection in SAR Robotics Applied Sciences search and rescue vision sensors thermal image multispectral image RGB image quadruped robot |
| title | Thermal, Multispectral, and RGB Vision Systems Analysis for Victim Detection in SAR Robotics |
| title_full | Thermal, Multispectral, and RGB Vision Systems Analysis for Victim Detection in SAR Robotics |
| title_fullStr | Thermal, Multispectral, and RGB Vision Systems Analysis for Victim Detection in SAR Robotics |
| title_full_unstemmed | Thermal, Multispectral, and RGB Vision Systems Analysis for Victim Detection in SAR Robotics |
| title_short | Thermal, Multispectral, and RGB Vision Systems Analysis for Victim Detection in SAR Robotics |
| title_sort | thermal multispectral and rgb vision systems analysis for victim detection in sar robotics |
| topic | search and rescue vision sensors thermal image multispectral image RGB image quadruped robot |
| url | https://www.mdpi.com/2076-3417/14/2/766 |
| work_keys_str_mv | AT christyancruzulloa thermalmultispectralandrgbvisionsystemsanalysisforvictimdetectioninsarrobotics AT davidorbea thermalmultispectralandrgbvisionsystemsanalysisforvictimdetectioninsarrobotics AT jaimedelcerro thermalmultispectralandrgbvisionsystemsanalysisforvictimdetectioninsarrobotics AT antoniobarrientos thermalmultispectralandrgbvisionsystemsanalysisforvictimdetectioninsarrobotics |