Enhancing airside monitoring: a multi-camera view approach for aircraft position estimation for digital control towers
A digital tower offers a cost-efficient substitute for traditional air traffic control towers and is anticipated to deliver video-based surveillance, which is especially beneficial for smaller airports. To fully unlock the potential of digital tower, sophisticated computer vision algorithms are pivo...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Conference Paper |
| Language: | English |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/172917 https://www.sesarju.eu/sesarinnovationdays |
| _version_ | 1811696363422875648 |
|---|---|
| author | Ali, Hasnain Pham, Duc-Thinh Alam, Sameer |
| author2 | School of Mechanical and Aerospace Engineering |
| author_facet | School of Mechanical and Aerospace Engineering Ali, Hasnain Pham, Duc-Thinh Alam, Sameer |
| author_sort | Ali, Hasnain |
| collection | NTU |
| description | A digital tower offers a cost-efficient substitute for traditional air traffic control towers and is anticipated to deliver video-based surveillance, which is especially beneficial for smaller airports. To fully unlock the potential of digital tower, sophisticated computer vision algorithms are pivotal for efficient surveillance. While current research predominantly concentrates on tracking aircraft movements on the airport surface, an equally crucial aspect lies in real-time monitoring of aircraft as they are are on finals. This capability plays a central role in enhancing both airport and runway operations. In this context, this study introduces a deep learning approach for precise estimation of the position of incoming aircraft, covering distances of up to 10 nautical miles. This approach surpasses the constraints of monoscopic techniques by leveraging multi-view video feeds obtained from digital towers. It combines Yolov7, an advanced real-time object detection model, with auxiliary regression and auto-calibration, allowing real-time tracking and feature extraction from different camera viewpoints. Furthermore, we propose an ensemble approach utilizing an Long Short-Term Memory model to combine input vectors, resulting in precise location estimation. Importantly, this method is designed to seamlessly adapt to different camera setups within digital towers. Its performance is evaluated using simulated video data from Singapore Changi Airport, showcasing stability in various scenarios with minimal predictive errors (Mean Absolute Percentage Error = 0.2%) over a 10 nautical mile range in clear weather conditions. These capabilities, when implemented in a digital tower setting, have the potential to significantly improve the controller's capacity to coordinate runway sequencing and final approach spacing, ultimately enhancing airport efficiency and safety remarkably. |
| first_indexed | 2024-10-01T07:38:10Z |
| format | Conference Paper |
| id | ntu-10356/172917 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T07:38:10Z |
| publishDate | 2024 |
| record_format | dspace |
| spelling | ntu-10356/1729172024-01-06T16:47:37Z Enhancing airside monitoring: a multi-camera view approach for aircraft position estimation for digital control towers Ali, Hasnain Pham, Duc-Thinh Alam, Sameer School of Mechanical and Aerospace Engineering 13th SESAR Innovation Days (SIDs 2023) Air Traffic Management Research Institute Engineering::Industrial engineering::Automation Engineering::Civil engineering::Transportation Engineering::Systems engineering Engineering::Computer science and engineering::Information systems::Information interfaces and presentation Computer Vision Video-Based Surveillance Multi-View Video Feeds Location Prediction A digital tower offers a cost-efficient substitute for traditional air traffic control towers and is anticipated to deliver video-based surveillance, which is especially beneficial for smaller airports. To fully unlock the potential of digital tower, sophisticated computer vision algorithms are pivotal for efficient surveillance. While current research predominantly concentrates on tracking aircraft movements on the airport surface, an equally crucial aspect lies in real-time monitoring of aircraft as they are are on finals. This capability plays a central role in enhancing both airport and runway operations. In this context, this study introduces a deep learning approach for precise estimation of the position of incoming aircraft, covering distances of up to 10 nautical miles. This approach surpasses the constraints of monoscopic techniques by leveraging multi-view video feeds obtained from digital towers. It combines Yolov7, an advanced real-time object detection model, with auxiliary regression and auto-calibration, allowing real-time tracking and feature extraction from different camera viewpoints. Furthermore, we propose an ensemble approach utilizing an Long Short-Term Memory model to combine input vectors, resulting in precise location estimation. Importantly, this method is designed to seamlessly adapt to different camera setups within digital towers. Its performance is evaluated using simulated video data from Singapore Changi Airport, showcasing stability in various scenarios with minimal predictive errors (Mean Absolute Percentage Error = 0.2%) over a 10 nautical mile range in clear weather conditions. These capabilities, when implemented in a digital tower setting, have the potential to significantly improve the controller's capacity to coordinate runway sequencing and final approach spacing, ultimately enhancing airport efficiency and safety remarkably. Civil Aviation Authority of Singapore (CAAS) National Research Foundation (NRF) Published version This research is supported by the National Research Foundation, Singapore, and the Civil Aviation Authority of Singapore, under the Aviation Transformation Programme. 2024-01-05T01:10:15Z 2024-01-05T01:10:15Z 2023 Conference Paper Ali, H., Pham, D. & Alam, S. (2023). Enhancing airside monitoring: a multi-camera view approach for aircraft position estimation for digital control towers. 13th SESAR Innovation Days (SIDs 2023). https://hdl.handle.net/10356/172917 https://www.sesarju.eu/sesarinnovationdays en © 2023 SESAR 3 Joint Undertaking. All rights reserved. This article may be downloaded for personal use only. Any other use requires prior permission of the copyright holder. application/pdf |
| spellingShingle | Engineering::Industrial engineering::Automation Engineering::Civil engineering::Transportation Engineering::Systems engineering Engineering::Computer science and engineering::Information systems::Information interfaces and presentation Computer Vision Video-Based Surveillance Multi-View Video Feeds Location Prediction Ali, Hasnain Pham, Duc-Thinh Alam, Sameer Enhancing airside monitoring: a multi-camera view approach for aircraft position estimation for digital control towers |
| title | Enhancing airside monitoring: a multi-camera view approach for aircraft position estimation for digital control towers |
| title_full | Enhancing airside monitoring: a multi-camera view approach for aircraft position estimation for digital control towers |
| title_fullStr | Enhancing airside monitoring: a multi-camera view approach for aircraft position estimation for digital control towers |
| title_full_unstemmed | Enhancing airside monitoring: a multi-camera view approach for aircraft position estimation for digital control towers |
| title_short | Enhancing airside monitoring: a multi-camera view approach for aircraft position estimation for digital control towers |
| title_sort | enhancing airside monitoring a multi camera view approach for aircraft position estimation for digital control towers |
| topic | Engineering::Industrial engineering::Automation Engineering::Civil engineering::Transportation Engineering::Systems engineering Engineering::Computer science and engineering::Information systems::Information interfaces and presentation Computer Vision Video-Based Surveillance Multi-View Video Feeds Location Prediction |
| url | https://hdl.handle.net/10356/172917 https://www.sesarju.eu/sesarinnovationdays |
| work_keys_str_mv | AT alihasnain enhancingairsidemonitoringamulticameraviewapproachforaircraftpositionestimationfordigitalcontroltowers AT phamducthinh enhancingairsidemonitoringamulticameraviewapproachforaircraftpositionestimationfordigitalcontroltowers AT alamsameer enhancingairsidemonitoringamulticameraviewapproachforaircraftpositionestimationfordigitalcontroltowers |