An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPS
In emergency response and disaster rescue, unmanned aerial vehicles (UAVs) onboard thermal infrared (TIR) sensors are an essential means of acquiring ground information in the nighttime working environment. To enable field personnel to make better decisions based on TIR video streams returned from a...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-05-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/14/9/2205 |
| _version_ | 1797503003944550400 |
|---|---|
| author | Xiang Ren Min Sun Xianfeng Zhang Lei Liu Xiuyuan Wang Hang Zhou |
| author_facet | Xiang Ren Min Sun Xianfeng Zhang Lei Liu Xiuyuan Wang Hang Zhou |
| author_sort | Xiang Ren |
| collection | DOAJ |
| description | In emergency response and disaster rescue, unmanned aerial vehicles (UAVs) onboard thermal infrared (TIR) sensors are an essential means of acquiring ground information in the nighttime working environment. To enable field personnel to make better decisions based on TIR video streams returned from a UAV, the geographic information enhancement of TIR video streams is required. At present, it is difficult for low-cost UAVs to carry high-precision attitude sensors and thus obtain high-precision camera attitude information to meet the enhanced processing requirements of UAV TIR video streams. To this end, this paper proposes an improved Kalman filter algorithm to improve the geographic registration (geo-registration) accuracy by fusing the positioning and heading data from the dual-antenna real-time kinematic global positioning system (RTK-GPS) with onboard internal measurement unit (IMU) data. This method can yield high-precision position and attitude data in real time based on low-cost UAV hardware, based on which high-precision geo-registration results can be obtained. The computational complexity can be reduced compared with video stream feature tracking algorithms. Furthermore, the problem of unstable matching due to the low resolution and texture level of TIR video streams can be avoided. The experimental results prove that the proposed method can reduce the registration error by 66.15%, and significantly improve the geo-registration accuracy of UAV TIR video streams. Thus, it can strongly support the popularization and practicality of the application of augmented reality (AR) technology to low-cost UAV platforms. |
| first_indexed | 2024-03-10T03:44:17Z |
| format | Article |
| id | doaj.art-ce184246f7914df698fc5ded96044057 |
| institution | Directory Open Access Journal |
| issn | 2072-4292 |
| language | English |
| last_indexed | 2024-03-10T03:44:17Z |
| publishDate | 2022-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj.art-ce184246f7914df698fc5ded960440572023-11-23T09:12:10ZengMDPI AGRemote Sensing2072-42922022-05-01149220510.3390/rs14092205An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPSXiang Ren0Min Sun1Xianfeng Zhang2Lei Liu3Xiuyuan Wang4Hang Zhou5Institute of Remote Sensing and GIS, Peking University, Beijing 100871, ChinaInstitute of Remote Sensing and GIS, Peking University, Beijing 100871, ChinaInstitute of Remote Sensing and GIS, Peking University, Beijing 100871, ChinaSchool of Space Information, Space Engineering University, Beijing 101416, ChinaInstitute of Remote Sensing and GIS, Peking University, Beijing 100871, ChinaInstitute of Remote Sensing and GIS, Peking University, Beijing 100871, ChinaIn emergency response and disaster rescue, unmanned aerial vehicles (UAVs) onboard thermal infrared (TIR) sensors are an essential means of acquiring ground information in the nighttime working environment. To enable field personnel to make better decisions based on TIR video streams returned from a UAV, the geographic information enhancement of TIR video streams is required. At present, it is difficult for low-cost UAVs to carry high-precision attitude sensors and thus obtain high-precision camera attitude information to meet the enhanced processing requirements of UAV TIR video streams. To this end, this paper proposes an improved Kalman filter algorithm to improve the geographic registration (geo-registration) accuracy by fusing the positioning and heading data from the dual-antenna real-time kinematic global positioning system (RTK-GPS) with onboard internal measurement unit (IMU) data. This method can yield high-precision position and attitude data in real time based on low-cost UAV hardware, based on which high-precision geo-registration results can be obtained. The computational complexity can be reduced compared with video stream feature tracking algorithms. Furthermore, the problem of unstable matching due to the low resolution and texture level of TIR video streams can be avoided. The experimental results prove that the proposed method can reduce the registration error by 66.15%, and significantly improve the geo-registration accuracy of UAV TIR video streams. Thus, it can strongly support the popularization and practicality of the application of augmented reality (AR) technology to low-cost UAV platforms.https://www.mdpi.com/2072-4292/14/9/2205TIR videoUAVaugmented realityRTKgeo-registration |
| spellingShingle | Xiang Ren Min Sun Xianfeng Zhang Lei Liu Xiuyuan Wang Hang Zhou An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPS Remote Sensing TIR video UAV augmented reality RTK geo-registration |
| title | An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPS |
| title_full | An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPS |
| title_fullStr | An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPS |
| title_full_unstemmed | An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPS |
| title_short | An AR Geo-Registration Algorithm for UAV TIR Video Streams Based on Dual-Antenna RTK-GPS |
| title_sort | ar geo registration algorithm for uav tir video streams based on dual antenna rtk gps |
| topic | TIR video UAV augmented reality RTK geo-registration |
| url | https://www.mdpi.com/2072-4292/14/9/2205 |
| work_keys_str_mv | AT xiangren anargeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT minsun anargeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT xianfengzhang anargeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT leiliu anargeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT xiuyuanwang anargeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT hangzhou anargeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT xiangren argeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT minsun argeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT xianfengzhang argeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT leiliu argeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT xiuyuanwang argeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps AT hangzhou argeoregistrationalgorithmforuavtirvideostreamsbasedondualantennartkgps |