Development of an autonomous camera-gimbal system for target following or artifact detection applications
Object detection is a fundamental requirement for a robot to perform tasks in target following applications. With increase in human-robot collaboration in various fields, the usage of robotic technologies in numerous settings and situations such as mapping and inspection, has widely increased. The m...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis-Master by Coursework |
| Language: | English |
| Published: |
Nanyang Technological University
2020
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/142947 |
| _version_ | 1811691720856829952 |
|---|---|
| author | Gnanaprakasam Naveen |
| author2 | Xie Lihua |
| author_facet | Xie Lihua Gnanaprakasam Naveen |
| author_sort | Gnanaprakasam Naveen |
| collection | NTU |
| description | Object detection is a fundamental requirement for a robot to perform tasks in target following applications. With increase in human-robot collaboration in various fields, the usage of robotic technologies in numerous settings and situations such as mapping and inspection, has widely increased. The major challenge in building a completely autonomous system is to enable the on-board camera, which is usually attached to a gimbal device to explore and detect targets in the environment. Cameras are one of the key components in object detection, so it is very important to build an efficient camera gimbal system to detect targets or objects in different environments and conditions. The objective of this research work is to design a camera-gimbal system and implement image processing techniques and deep learning pipeline to autonomously detect targets or objects, depending on the application. On successful development, the camera gimbal system has been tested in different scenarios to measure the efficiency of object detection in the developed system. Ten different models were tested in the developed system and suitable models were selected based on the speed and accuracy. RFCN Resnet101 and Faster RCNN Resenet101 models were selected for their consistent speed of 30-32 milli seconds and accuracy measure of 96-99%. Various tests were conducted on the camera system, with the selected deep learning models, to validate the reliability and robustness of the developed system. As a result, the developed system was proven to be potentially placed both on ground and aerial mobile robots. This research work focuses on improvement of accuracy of autonomous object detection by utilizing the camera gimbal system under different scenarios to help in increasing the performance of target following and detection applications. |
| first_indexed | 2024-10-01T06:24:23Z |
| format | Thesis-Master by Coursework |
| id | ntu-10356/142947 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T06:24:23Z |
| publishDate | 2020 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1429472023-07-04T16:10:48Z Development of an autonomous camera-gimbal system for target following or artifact detection applications Gnanaprakasam Naveen Xie Lihua School of Electrical and Electronic Engineering ELHXIE@ntu.edu.sg Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics Object detection is a fundamental requirement for a robot to perform tasks in target following applications. With increase in human-robot collaboration in various fields, the usage of robotic technologies in numerous settings and situations such as mapping and inspection, has widely increased. The major challenge in building a completely autonomous system is to enable the on-board camera, which is usually attached to a gimbal device to explore and detect targets in the environment. Cameras are one of the key components in object detection, so it is very important to build an efficient camera gimbal system to detect targets or objects in different environments and conditions. The objective of this research work is to design a camera-gimbal system and implement image processing techniques and deep learning pipeline to autonomously detect targets or objects, depending on the application. On successful development, the camera gimbal system has been tested in different scenarios to measure the efficiency of object detection in the developed system. Ten different models were tested in the developed system and suitable models were selected based on the speed and accuracy. RFCN Resnet101 and Faster RCNN Resenet101 models were selected for their consistent speed of 30-32 milli seconds and accuracy measure of 96-99%. Various tests were conducted on the camera system, with the selected deep learning models, to validate the reliability and robustness of the developed system. As a result, the developed system was proven to be potentially placed both on ground and aerial mobile robots. This research work focuses on improvement of accuracy of autonomous object detection by utilizing the camera gimbal system under different scenarios to help in increasing the performance of target following and detection applications. Master of Science (Computer Control and Automation) 2020-07-15T02:42:18Z 2020-07-15T02:42:18Z 2020 Thesis-Master by Coursework https://hdl.handle.net/10356/142947 en application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics Gnanaprakasam Naveen Development of an autonomous camera-gimbal system for target following or artifact detection applications |
| title | Development of an autonomous camera-gimbal system for target following or artifact detection applications |
| title_full | Development of an autonomous camera-gimbal system for target following or artifact detection applications |
| title_fullStr | Development of an autonomous camera-gimbal system for target following or artifact detection applications |
| title_full_unstemmed | Development of an autonomous camera-gimbal system for target following or artifact detection applications |
| title_short | Development of an autonomous camera-gimbal system for target following or artifact detection applications |
| title_sort | development of an autonomous camera gimbal system for target following or artifact detection applications |
| topic | Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics |
| url | https://hdl.handle.net/10356/142947 |
| work_keys_str_mv | AT gnanaprakasamnaveen developmentofanautonomouscameragimbalsystemfortargetfollowingorartifactdetectionapplications |