Multiscale Image Matching for Automated Calibration of UAV-Based Frame and Line Camera Systems
Unmanned aerial vehicles (UAVs) equipped with integrated global navigation satellite systems/inertial navigation systems together with frame and/or line cameras are used for a variety of applications. Geometric system calibration is crucial for delivering accurate products from...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9364670/ |
| _version_ | 1818591876025942016 |
|---|---|
| author | Seyyed Meghdad Hasheminasab Tian Zhou Lisa LaForest Ayman Habib |
| author_facet | Seyyed Meghdad Hasheminasab Tian Zhou Lisa LaForest Ayman Habib |
| author_sort | Seyyed Meghdad Hasheminasab |
| collection | DOAJ |
| description | Unmanned aerial vehicles (UAVs) equipped with integrated global navigation satellite systems/inertial navigation systems together with frame and/or line cameras are used for a variety of applications. Geometric system calibration is crucial for delivering accurate products from UAV-based imaging systems. This article presents automated geometric calibration strategies for UAV-based frame and line camera systems to estimate accurate system calibration parameters without the need for ground control points or manual measurements of tie points. The matching strategy used in this article to establish conjugate features among overlapping frame camera images is based on a traditional Structure from Motion technique augmented with several layers of matching outlier removal. On the other hand, a new strategy relying on ortho-rectified images is introduced for automated feature matching in line camera scenes. Then, a general bundle adjustment procedure with system calibration capabilities for frame and line cameras is presented, where the derived automated tie points are used for estimating accurate geometric system calibration parameters. The proposed approach is evaluated using four datasets—two datasets captured by frame cameras and two datasets captured by line cameras. The results show that the developed automated calibration strategy is capable of producing the same level of absolute accuracy when compared to using manually measured tie points for both frame camera and line camera systems. Results also indicate that the presented automated system calibration approach can be applied to systems even with significant deviation of actual system parameters from their nominal values, and still produce accurate estimates of calibration parameters. |
| first_indexed | 2024-12-16T10:19:24Z |
| format | Article |
| id | doaj.art-710d179794ed40a6a5c098b45c18f6a9 |
| institution | Directory Open Access Journal |
| issn | 2151-1535 |
| language | English |
| last_indexed | 2024-12-16T10:19:24Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj.art-710d179794ed40a6a5c098b45c18f6a92022-12-21T22:35:21ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352021-01-01143133315010.1109/JSTARS.2021.30625739364670Multiscale Image Matching for Automated Calibration of UAV-Based Frame and Line Camera SystemsSeyyed Meghdad Hasheminasab0https://orcid.org/0000-0003-3647-1480Tian Zhou1https://orcid.org/0000-0001-6423-4090Lisa LaForest2https://orcid.org/0000-0002-7372-9682Ayman Habib3Lyles School of Civil Engineering, Purdue University, West Lafayette, IN, USALyles School of Civil Engineering, Purdue University, West Lafayette, IN, USALyles School of Civil Engineering, Purdue University, West Lafayette, IN, USALyles School of Civil Engineering, Purdue University, West Lafayette, IN, USAUnmanned aerial vehicles (UAVs) equipped with integrated global navigation satellite systems/inertial navigation systems together with frame and/or line cameras are used for a variety of applications. Geometric system calibration is crucial for delivering accurate products from UAV-based imaging systems. This article presents automated geometric calibration strategies for UAV-based frame and line camera systems to estimate accurate system calibration parameters without the need for ground control points or manual measurements of tie points. The matching strategy used in this article to establish conjugate features among overlapping frame camera images is based on a traditional Structure from Motion technique augmented with several layers of matching outlier removal. On the other hand, a new strategy relying on ortho-rectified images is introduced for automated feature matching in line camera scenes. Then, a general bundle adjustment procedure with system calibration capabilities for frame and line cameras is presented, where the derived automated tie points are used for estimating accurate geometric system calibration parameters. The proposed approach is evaluated using four datasets—two datasets captured by frame cameras and two datasets captured by line cameras. The results show that the developed automated calibration strategy is capable of producing the same level of absolute accuracy when compared to using manually measured tie points for both frame camera and line camera systems. Results also indicate that the presented automated system calibration approach can be applied to systems even with significant deviation of actual system parameters from their nominal values, and still produce accurate estimates of calibration parameters.https://ieeexplore.ieee.org/document/9364670/Hyperspectral line camerasimage matchingintegrated global navigation satellite system/inertial navigation system (GNSS/INS)RGB frame camerassystem calibrationunmanned aerial vehicles (UAVs) |
| spellingShingle | Seyyed Meghdad Hasheminasab Tian Zhou Lisa LaForest Ayman Habib Multiscale Image Matching for Automated Calibration of UAV-Based Frame and Line Camera Systems IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Hyperspectral line cameras image matching integrated global navigation satellite system/inertial navigation system (GNSS/INS) RGB frame cameras system calibration unmanned aerial vehicles (UAVs) |
| title | Multiscale Image Matching for Automated Calibration of UAV-Based Frame and Line Camera Systems |
| title_full | Multiscale Image Matching for Automated Calibration of UAV-Based Frame and Line Camera Systems |
| title_fullStr | Multiscale Image Matching for Automated Calibration of UAV-Based Frame and Line Camera Systems |
| title_full_unstemmed | Multiscale Image Matching for Automated Calibration of UAV-Based Frame and Line Camera Systems |
| title_short | Multiscale Image Matching for Automated Calibration of UAV-Based Frame and Line Camera Systems |
| title_sort | multiscale image matching for automated calibration of uav based frame and line camera systems |
| topic | Hyperspectral line cameras image matching integrated global navigation satellite system/inertial navigation system (GNSS/INS) RGB frame cameras system calibration unmanned aerial vehicles (UAVs) |
| url | https://ieeexplore.ieee.org/document/9364670/ |
| work_keys_str_mv | AT seyyedmeghdadhasheminasab multiscaleimagematchingforautomatedcalibrationofuavbasedframeandlinecamerasystems AT tianzhou multiscaleimagematchingforautomatedcalibrationofuavbasedframeandlinecamerasystems AT lisalaforest multiscaleimagematchingforautomatedcalibrationofuavbasedframeandlinecamerasystems AT aymanhabib multiscaleimagematchingforautomatedcalibrationofuavbasedframeandlinecamerasystems |