Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface
A visuo-haptic augmented reality (VHAR) interface is presented enabling an operator to teleoperate an unmanned aerial vehicle (UAV) equipped with a custom CdZnTe-based spectroscopic gamma-ray detector in outdoor environments. The task is to localize nuclear radiation sources, whose location is unkno...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2017-09-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/17/10/2234 |
| _version_ | 1817990750746443776 |
|---|---|
| author | Jacopo Aleotti Giorgio Micconi Stefano Caselli Giacomo Benassi Nicola Zambelli Manuele Bettelli Andrea Zappettini |
| author_facet | Jacopo Aleotti Giorgio Micconi Stefano Caselli Giacomo Benassi Nicola Zambelli Manuele Bettelli Andrea Zappettini |
| author_sort | Jacopo Aleotti |
| collection | DOAJ |
| description | A visuo-haptic augmented reality (VHAR) interface is presented enabling an operator to teleoperate an unmanned aerial vehicle (UAV) equipped with a custom CdZnTe-based spectroscopic gamma-ray detector in outdoor environments. The task is to localize nuclear radiation sources, whose location is unknown to the user, without the close exposure of the operator. The developed detector also enables identification of the localized nuclear sources. The aim of the VHAR interface is to increase the situation awareness of the operator. The user teleoperates the UAV using a 3DOF haptic device that provides an attractive force feedback around the location of the most intense detected radiation source. Moreover, a fixed camera on the ground observes the environment where the UAV is flying. A 3D augmented reality scene is displayed on a computer screen accessible to the operator. Multiple types of graphical overlays are shown, including sensor data acquired by the nuclear radiation detector, a virtual cursor that tracks the UAV and geographical information, such as buildings. Experiments performed in a real environment are reported using an intense nuclear source. |
| first_indexed | 2024-04-14T01:03:07Z |
| format | Article |
| id | doaj.art-27b71c62d1404f0ca2713ed551756793 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-04-14T01:03:07Z |
| publishDate | 2017-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-27b71c62d1404f0ca2713ed5517567932022-12-22T02:21:19ZengMDPI AGSensors1424-82202017-09-011710223410.3390/s17102234s17102234Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality InterfaceJacopo Aleotti0Giorgio Micconi1Stefano Caselli2Giacomo Benassi3Nicola Zambelli4Manuele Bettelli5Andrea Zappettini6Department of Engineering and Architecture, University of Parma, 43124 Parma, ItalyDepartment of Engineering and Architecture, University of Parma, 43124 Parma, ItalyDepartment of Engineering and Architecture, University of Parma, 43124 Parma, Italydue2lab s.r.l., 43121 Parma, Italydue2lab s.r.l., 43121 Parma, ItalyIMEM-CNR, 43124 Parma, ItalyIMEM-CNR, 43124 Parma, ItalyA visuo-haptic augmented reality (VHAR) interface is presented enabling an operator to teleoperate an unmanned aerial vehicle (UAV) equipped with a custom CdZnTe-based spectroscopic gamma-ray detector in outdoor environments. The task is to localize nuclear radiation sources, whose location is unknown to the user, without the close exposure of the operator. The developed detector also enables identification of the localized nuclear sources. The aim of the VHAR interface is to increase the situation awareness of the operator. The user teleoperates the UAV using a 3DOF haptic device that provides an attractive force feedback around the location of the most intense detected radiation source. Moreover, a fixed camera on the ground observes the environment where the UAV is flying. A 3D augmented reality scene is displayed on a computer screen accessible to the operator. Multiple types of graphical overlays are shown, including sensor data acquired by the nuclear radiation detector, a virtual cursor that tracks the UAV and geographical information, such as buildings. Experiments performed in a real environment are reported using an intense nuclear source.https://www.mdpi.com/1424-8220/17/10/2234CdZnTe-based detectornuclear radiation detectorhaptic teleoperationunmanned aerial vehicles |
| spellingShingle | Jacopo Aleotti Giorgio Micconi Stefano Caselli Giacomo Benassi Nicola Zambelli Manuele Bettelli Andrea Zappettini Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface Sensors CdZnTe-based detector nuclear radiation detector haptic teleoperation unmanned aerial vehicles |
| title | Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface |
| title_full | Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface |
| title_fullStr | Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface |
| title_full_unstemmed | Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface |
| title_short | Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface |
| title_sort | detection of nuclear sources by uav teleoperation using a visuo haptic augmented reality interface |
| topic | CdZnTe-based detector nuclear radiation detector haptic teleoperation unmanned aerial vehicles |
| url | https://www.mdpi.com/1424-8220/17/10/2234 |
| work_keys_str_mv | AT jacopoaleotti detectionofnuclearsourcesbyuavteleoperationusingavisuohapticaugmentedrealityinterface AT giorgiomicconi detectionofnuclearsourcesbyuavteleoperationusingavisuohapticaugmentedrealityinterface AT stefanocaselli detectionofnuclearsourcesbyuavteleoperationusingavisuohapticaugmentedrealityinterface AT giacomobenassi detectionofnuclearsourcesbyuavteleoperationusingavisuohapticaugmentedrealityinterface AT nicolazambelli detectionofnuclearsourcesbyuavteleoperationusingavisuohapticaugmentedrealityinterface AT manuelebettelli detectionofnuclearsourcesbyuavteleoperationusingavisuohapticaugmentedrealityinterface AT andreazappettini detectionofnuclearsourcesbyuavteleoperationusingavisuohapticaugmentedrealityinterface |