Intelligent vision based coordinated control for quadcopter

Within the past decade, quadcopters have been widely used in military operations, surveillance, search missions and many more interesting areas. They have also become the focus of aerodynamics research institutes to test flight control theory, autonomous navigation and more. When quadcopters are man...

Full description

Bibliographic Details
Main Author: Hsu, Htet
Other Authors: School of Computer Engineering
Format: Final Year Project (FYP)
Language:English
Published: 2014
Subjects:
Online Access:http://hdl.handle.net/10356/59049
_version_ 1811687252554678272
author Hsu, Htet
author2 School of Computer Engineering
author_facet School of Computer Engineering
Hsu, Htet
author_sort Hsu, Htet
collection NTU
description Within the past decade, quadcopters have been widely used in military operations, surveillance, search missions and many more interesting areas. They have also become the focus of aerodynamics research institutes to test flight control theory, autonomous navigation and more. When quadcopters are manufactured smaller in recent years and called nano quadcopters of incredible small size, its potential for more useful applications sparked interest for many. The challenge with quadcopters is to make it fly stably and hold a target position. Increasing amounts of interest go to improving natural interaction with quadcopters. Hence the goal of this project is set to (1) explore possible means to control a nano quadcopter (2) implement a close-loop control system for stable hovering (3) implement a vision-based system to control quadcopter using gestures. From our project, we have discovered and implemented possible means to control a nano quadcopter. They include manual control using a joystick controller such as Xbox 360 controller or Playstation controller, keyboard and mouse as controllers and gesture-based controllers such as Leap Motion controller and Microsoft Kinect controller. Close-loop control system was implemented using PID controller. Input to PID controller is the difference between target position and actual position of a nano quadcopter. Actual position of a nano quadcopter was determined by tracking red ball attached on top of nano quadcopter and applying imaging processing techniques on RGB and depth images produced by Microsoft Kinect. OpenNI framework and NITE middleware allowed us to develop skeleton tracking algorithm. Gesture recognition algorithm implementation was based on skeleton joint data of left hand of the user. Visualization of skeleton joint data was also made available.
first_indexed 2024-10-01T05:13:22Z
format Final Year Project (FYP)
id ntu-10356/59049
institution Nanyang Technological University
language English
last_indexed 2024-10-01T05:13:22Z
publishDate 2014
record_format dspace
spelling ntu-10356/590492023-03-03T20:53:20Z Intelligent vision based coordinated control for quadcopter Hsu, Htet School of Computer Engineering Suresh Sundaram DRNTU::Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering DRNTU::Engineering::Mechanical engineering::Motor vehicles DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Within the past decade, quadcopters have been widely used in military operations, surveillance, search missions and many more interesting areas. They have also become the focus of aerodynamics research institutes to test flight control theory, autonomous navigation and more. When quadcopters are manufactured smaller in recent years and called nano quadcopters of incredible small size, its potential for more useful applications sparked interest for many. The challenge with quadcopters is to make it fly stably and hold a target position. Increasing amounts of interest go to improving natural interaction with quadcopters. Hence the goal of this project is set to (1) explore possible means to control a nano quadcopter (2) implement a close-loop control system for stable hovering (3) implement a vision-based system to control quadcopter using gestures. From our project, we have discovered and implemented possible means to control a nano quadcopter. They include manual control using a joystick controller such as Xbox 360 controller or Playstation controller, keyboard and mouse as controllers and gesture-based controllers such as Leap Motion controller and Microsoft Kinect controller. Close-loop control system was implemented using PID controller. Input to PID controller is the difference between target position and actual position of a nano quadcopter. Actual position of a nano quadcopter was determined by tracking red ball attached on top of nano quadcopter and applying imaging processing techniques on RGB and depth images produced by Microsoft Kinect. OpenNI framework and NITE middleware allowed us to develop skeleton tracking algorithm. Gesture recognition algorithm implementation was based on skeleton joint data of left hand of the user. Visualization of skeleton joint data was also made available. Bachelor of Engineering (Computer Engineering) 2014-04-22T01:48:53Z 2014-04-22T01:48:53Z 2014 2014 Final Year Project (FYP) http://hdl.handle.net/10356/59049 en Nanyang Technological University 43 p. application/pdf
spellingShingle DRNTU::Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering
DRNTU::Engineering::Mechanical engineering::Motor vehicles
DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
Hsu, Htet
Intelligent vision based coordinated control for quadcopter
title Intelligent vision based coordinated control for quadcopter
title_full Intelligent vision based coordinated control for quadcopter
title_fullStr Intelligent vision based coordinated control for quadcopter
title_full_unstemmed Intelligent vision based coordinated control for quadcopter
title_short Intelligent vision based coordinated control for quadcopter
title_sort intelligent vision based coordinated control for quadcopter
topic DRNTU::Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering
DRNTU::Engineering::Mechanical engineering::Motor vehicles
DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
url http://hdl.handle.net/10356/59049
work_keys_str_mv AT hsuhtet intelligentvisionbasedcoordinatedcontrolforquadcopter