UAV-Assisted Wide Area Multi-Camera Space Alignment Based on Spatiotemporal Feature Map
In this paper, we investigate the problem of aligning multiple deployed camera into one united coordinate system for cross-camera information sharing and intercommunication. However, the difficulty is greatly increased when faced with large-scale scene under chaotic camera deployment. To address thi...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-03-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/13/6/1117 |
| _version_ | 1797541273492520960 |
|---|---|
| author | Jing Li Yuguang Xie Congcong Li Yanran Dai Jiaxin Ma Zheng Dong Tao Yang |
| author_facet | Jing Li Yuguang Xie Congcong Li Yanran Dai Jiaxin Ma Zheng Dong Tao Yang |
| author_sort | Jing Li |
| collection | DOAJ |
| description | In this paper, we investigate the problem of aligning multiple deployed camera into one united coordinate system for cross-camera information sharing and intercommunication. However, the difficulty is greatly increased when faced with large-scale scene under chaotic camera deployment. To address this problem, we propose a UAV-assisted wide area multi-camera space alignment approach based on spatiotemporal feature map. It employs the great global perception of Unmanned Aerial Vehicles (UAVs) to meet the challenge from wide-range environment. Concretely, we first present a novel spatiotemporal feature map construction approach to represent the input aerial and ground monitoring data. In this way, the motion consistency across view is well mined to overcome the great perspective gap between the UAV and ground cameras. To obtain the corresponding relationship between their pixels, we propose a cross-view spatiotemporal matching strategy. Through solving relative relationship with the above air-to-ground point correspondences, all ground cameras can be aligned into one surveillance space. The proposed approach was evaluated in both simulation and real environments qualitatively and quantitatively. Extensive experimental results demonstrate that our system can successfully align all ground cameras with very small pixel error. Additionally, the comparisons with other works on different test situations also verify its superior performance. |
| first_indexed | 2024-03-10T13:12:45Z |
| format | Article |
| id | doaj.art-97e5f747e2c7432385da293160847c94 |
| institution | Directory Open Access Journal |
| issn | 2072-4292 |
| language | English |
| last_indexed | 2024-03-10T13:12:45Z |
| publishDate | 2021-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj.art-97e5f747e2c7432385da293160847c942023-11-21T10:36:47ZengMDPI AGRemote Sensing2072-42922021-03-01136111710.3390/rs13061117UAV-Assisted Wide Area Multi-Camera Space Alignment Based on Spatiotemporal Feature MapJing Li0Yuguang Xie1Congcong Li2Yanran Dai3Jiaxin Ma4Zheng Dong5Tao Yang6School of Telecommunications Engineering, Xidian University, Xi’an 710071, ChinaSchool of Telecommunications Engineering, Xidian University, Xi’an 710071, ChinaSchool of Telecommunications Engineering, Xidian University, Xi’an 710071, ChinaSchool of Telecommunications Engineering, Xidian University, Xi’an 710071, ChinaSchool of Telecommunications Engineering, Xidian University, Xi’an 710071, ChinaNational Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP School of Computer Science, Northwestern Polytechnical University, Xi’an 710129, ChinaNational Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP School of Computer Science, Northwestern Polytechnical University, Xi’an 710129, ChinaIn this paper, we investigate the problem of aligning multiple deployed camera into one united coordinate system for cross-camera information sharing and intercommunication. However, the difficulty is greatly increased when faced with large-scale scene under chaotic camera deployment. To address this problem, we propose a UAV-assisted wide area multi-camera space alignment approach based on spatiotemporal feature map. It employs the great global perception of Unmanned Aerial Vehicles (UAVs) to meet the challenge from wide-range environment. Concretely, we first present a novel spatiotemporal feature map construction approach to represent the input aerial and ground monitoring data. In this way, the motion consistency across view is well mined to overcome the great perspective gap between the UAV and ground cameras. To obtain the corresponding relationship between their pixels, we propose a cross-view spatiotemporal matching strategy. Through solving relative relationship with the above air-to-ground point correspondences, all ground cameras can be aligned into one surveillance space. The proposed approach was evaluated in both simulation and real environments qualitatively and quantitatively. Extensive experimental results demonstrate that our system can successfully align all ground cameras with very small pixel error. Additionally, the comparisons with other works on different test situations also verify its superior performance.https://www.mdpi.com/2072-4292/13/6/1117multi-camera systemspace alignmentUAV-assisted calibrationcross-view matchingspatiotemporal feature mapview-invariant description |
| spellingShingle | Jing Li Yuguang Xie Congcong Li Yanran Dai Jiaxin Ma Zheng Dong Tao Yang UAV-Assisted Wide Area Multi-Camera Space Alignment Based on Spatiotemporal Feature Map Remote Sensing multi-camera system space alignment UAV-assisted calibration cross-view matching spatiotemporal feature map view-invariant description |
| title | UAV-Assisted Wide Area Multi-Camera Space Alignment Based on Spatiotemporal Feature Map |
| title_full | UAV-Assisted Wide Area Multi-Camera Space Alignment Based on Spatiotemporal Feature Map |
| title_fullStr | UAV-Assisted Wide Area Multi-Camera Space Alignment Based on Spatiotemporal Feature Map |
| title_full_unstemmed | UAV-Assisted Wide Area Multi-Camera Space Alignment Based on Spatiotemporal Feature Map |
| title_short | UAV-Assisted Wide Area Multi-Camera Space Alignment Based on Spatiotemporal Feature Map |
| title_sort | uav assisted wide area multi camera space alignment based on spatiotemporal feature map |
| topic | multi-camera system space alignment UAV-assisted calibration cross-view matching spatiotemporal feature map view-invariant description |
| url | https://www.mdpi.com/2072-4292/13/6/1117 |
| work_keys_str_mv | AT jingli uavassistedwideareamulticameraspacealignmentbasedonspatiotemporalfeaturemap AT yuguangxie uavassistedwideareamulticameraspacealignmentbasedonspatiotemporalfeaturemap AT congcongli uavassistedwideareamulticameraspacealignmentbasedonspatiotemporalfeaturemap AT yanrandai uavassistedwideareamulticameraspacealignmentbasedonspatiotemporalfeaturemap AT jiaxinma uavassistedwideareamulticameraspacealignmentbasedonspatiotemporalfeaturemap AT zhengdong uavassistedwideareamulticameraspacealignmentbasedonspatiotemporalfeaturemap AT taoyang uavassistedwideareamulticameraspacealignmentbasedonspatiotemporalfeaturemap |