Visual Odometry Using Pixel Processor Arrays for Unmanned Aerial Systems in GPS Denied Environments
Environments in which Global Positioning Systems (GPS), or more generally Global Navigation Satellite System (GNSS), signals are denied or degraded pose problems for the guidance, navigation, and control of autonomous systems. This can make operating in hostile GNSS-Impaired environments, such as in...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2020-09-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/article/10.3389/frobt.2020.00126/full |
| _version_ | 1818249494048800768 |
|---|---|
| author | Alexander McConville Laurie Bose Robert Clarke Walterio Mayol-Cuevas Jianing Chen Colin Greatwood Stephen Carey Piotr Dudek Tom Richardson |
| author_facet | Alexander McConville Laurie Bose Robert Clarke Walterio Mayol-Cuevas Jianing Chen Colin Greatwood Stephen Carey Piotr Dudek Tom Richardson |
| author_sort | Alexander McConville |
| collection | DOAJ |
| description | Environments in which Global Positioning Systems (GPS), or more generally Global Navigation Satellite System (GNSS), signals are denied or degraded pose problems for the guidance, navigation, and control of autonomous systems. This can make operating in hostile GNSS-Impaired environments, such as indoors, or in urban and natural canyons, impossible or extremely difficult. Pixel Processor Array (PPA) cameras—in conjunction with other on-board sensors—can be used to address this problem, aiding in tracking, localization, and control. In this paper we demonstrate the use of a PPA device—the SCAMP vision chip—combining perception and compute capabilities on the same device for aiding in real-time navigation and control of aerial robots. A PPA consists of an array of Processing Elements (PEs), each of which features light capture, processing, and storage capabilities. This allows various image processing tasks to be efficiently performed directly on the sensor itself. Within this paper we demonstrate visual odometry and target identification running concurrently on-board a single PPA vision chip at a combined frequency in the region of 400 Hz. Results from outdoor multirotor test flights are given along with comparisons against baseline GPS results. The SCAMP PPA's High Dynamic Range (HDR) and ability to run multiple algorithms at adaptive rates makes the sensor well suited for addressing outdoor flight of small UAS in GNSS challenging or denied environments. HDR allows operation to continue during the transition from indoor to outdoor environments, and in other situations where there are significant variations in light levels. Additionally, the PPA only needs to output specific information such as the optic flow and target position, rather than having to output entire images. This significantly reduces the bandwidth required for communication between the sensor and on-board flight computer, enabling high frame rate, low power operation. |
| first_indexed | 2024-12-12T15:37:23Z |
| format | Article |
| id | doaj.art-5cd0c9f4226c406e8a2f1611f0522efb |
| institution | Directory Open Access Journal |
| issn | 2296-9144 |
| language | English |
| last_indexed | 2024-12-12T15:37:23Z |
| publishDate | 2020-09-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj.art-5cd0c9f4226c406e8a2f1611f0522efb2022-12-22T00:19:59ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442020-09-01710.3389/frobt.2020.00126541493Visual Odometry Using Pixel Processor Arrays for Unmanned Aerial Systems in GPS Denied EnvironmentsAlexander McConville0Laurie Bose1Robert Clarke2Walterio Mayol-Cuevas3Jianing Chen4Colin Greatwood5Stephen Carey6Piotr Dudek7Tom Richardson8Flight Lab, Department of Aerospace Engineering, University of Bristol, Bristol, United KingdomVisual Information Laboratory, Department of Computer Science, University of Bristol, Bristol, United KingdomFlight Lab, Department of Aerospace Engineering, University of Bristol, Bristol, United KingdomVisual Information Laboratory, Department of Computer Science, University of Bristol, Bristol, United KingdomDepartment of Electrical Engineering and Electronics, The University of Manchester, Manchester, United KingdomPerceptual Robotics, Bristol, United KingdomDepartment of Electrical Engineering and Electronics, The University of Manchester, Manchester, United KingdomDepartment of Electrical Engineering and Electronics, The University of Manchester, Manchester, United KingdomFlight Lab, Department of Aerospace Engineering, University of Bristol, Bristol, United KingdomEnvironments in which Global Positioning Systems (GPS), or more generally Global Navigation Satellite System (GNSS), signals are denied or degraded pose problems for the guidance, navigation, and control of autonomous systems. This can make operating in hostile GNSS-Impaired environments, such as indoors, or in urban and natural canyons, impossible or extremely difficult. Pixel Processor Array (PPA) cameras—in conjunction with other on-board sensors—can be used to address this problem, aiding in tracking, localization, and control. In this paper we demonstrate the use of a PPA device—the SCAMP vision chip—combining perception and compute capabilities on the same device for aiding in real-time navigation and control of aerial robots. A PPA consists of an array of Processing Elements (PEs), each of which features light capture, processing, and storage capabilities. This allows various image processing tasks to be efficiently performed directly on the sensor itself. Within this paper we demonstrate visual odometry and target identification running concurrently on-board a single PPA vision chip at a combined frequency in the region of 400 Hz. Results from outdoor multirotor test flights are given along with comparisons against baseline GPS results. The SCAMP PPA's High Dynamic Range (HDR) and ability to run multiple algorithms at adaptive rates makes the sensor well suited for addressing outdoor flight of small UAS in GNSS challenging or denied environments. HDR allows operation to continue during the transition from indoor to outdoor environments, and in other situations where there are significant variations in light levels. Additionally, the PPA only needs to output specific information such as the optic flow and target position, rather than having to output entire images. This significantly reduces the bandwidth required for communication between the sensor and on-board flight computer, enabling high frame rate, low power operation.https://www.frontiersin.org/article/10.3389/frobt.2020.00126/fullUASnavigationGPS deniedpixel processor arrayvisual odometrySIND |
| spellingShingle | Alexander McConville Laurie Bose Robert Clarke Walterio Mayol-Cuevas Jianing Chen Colin Greatwood Stephen Carey Piotr Dudek Tom Richardson Visual Odometry Using Pixel Processor Arrays for Unmanned Aerial Systems in GPS Denied Environments Frontiers in Robotics and AI UAS navigation GPS denied pixel processor array visual odometry SIND |
| title | Visual Odometry Using Pixel Processor Arrays for Unmanned Aerial Systems in GPS Denied Environments |
| title_full | Visual Odometry Using Pixel Processor Arrays for Unmanned Aerial Systems in GPS Denied Environments |
| title_fullStr | Visual Odometry Using Pixel Processor Arrays for Unmanned Aerial Systems in GPS Denied Environments |
| title_full_unstemmed | Visual Odometry Using Pixel Processor Arrays for Unmanned Aerial Systems in GPS Denied Environments |
| title_short | Visual Odometry Using Pixel Processor Arrays for Unmanned Aerial Systems in GPS Denied Environments |
| title_sort | visual odometry using pixel processor arrays for unmanned aerial systems in gps denied environments |
| topic | UAS navigation GPS denied pixel processor array visual odometry SIND |
| url | https://www.frontiersin.org/article/10.3389/frobt.2020.00126/full |
| work_keys_str_mv | AT alexandermcconville visualodometryusingpixelprocessorarraysforunmannedaerialsystemsingpsdeniedenvironments AT lauriebose visualodometryusingpixelprocessorarraysforunmannedaerialsystemsingpsdeniedenvironments AT robertclarke visualodometryusingpixelprocessorarraysforunmannedaerialsystemsingpsdeniedenvironments AT walteriomayolcuevas visualodometryusingpixelprocessorarraysforunmannedaerialsystemsingpsdeniedenvironments AT jianingchen visualodometryusingpixelprocessorarraysforunmannedaerialsystemsingpsdeniedenvironments AT colingreatwood visualodometryusingpixelprocessorarraysforunmannedaerialsystemsingpsdeniedenvironments AT stephencarey visualodometryusingpixelprocessorarraysforunmannedaerialsystemsingpsdeniedenvironments AT piotrdudek visualodometryusingpixelprocessorarraysforunmannedaerialsystemsingpsdeniedenvironments AT tomrichardson visualodometryusingpixelprocessorarraysforunmannedaerialsystemsingpsdeniedenvironments |