Interactive multi-object tracking for virtual object manipulation
We present an interactive system to manipulate a virtual object by tracking multiple hands in 3D space using a Kinect device. The system segments hand shapes from a captured 3D scene by using depth information and active contours. A hand shape is recognized by a trained naive Bayes classifier, wheth...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2013-10-01
|
| Series: | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | http://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/II-3-W2/19/2013/isprsannals-II-3-W2-19-2013.pdf |
| _version_ | 1818910779380858880 |
|---|---|
| author | Y. Guo M. Ying Yang B. Rosenhahn |
| author_facet | Y. Guo M. Ying Yang B. Rosenhahn |
| author_sort | Y. Guo |
| collection | DOAJ |
| description | We present an interactive system to manipulate a virtual object by tracking multiple hands in 3D space using a Kinect device. The
system segments hand shapes from a captured 3D scene by using depth information and active contours. A hand shape is recognized
by a trained naive Bayes classifier, whether it belongs to a palm, a pointing hand form or both hands with simple occlusion. A plane is
approximated by using RANSAC for a palm hand form, while a vector from the hand centroid to the fingertip is obtained for a pointing
hand form by using ICP as tracking method. A shape of simple occluded two hands is split into a palm and an incomplete pointing
hand form, whose missing data is estimated by using PCA. The system works in semi-real time. |
| first_indexed | 2024-12-19T22:48:14Z |
| format | Article |
| id | doaj.art-51208fc550f84f87b33d254da5ed08e0 |
| institution | Directory Open Access Journal |
| issn | 2194-9042 2194-9050 |
| language | English |
| last_indexed | 2024-12-19T22:48:14Z |
| publishDate | 2013-10-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-51208fc550f84f87b33d254da5ed08e02022-12-21T20:02:54ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502013-10-01II-3/W2192410.5194/isprsannals-II-3-W2-19-2013Interactive multi-object tracking for virtual object manipulationY. Guo0M. Ying Yang1B. Rosenhahn2Institute for Information processing (TNT), Leibniz University Hanover Appelstr. 9A, 30167 Hannover, GermanyInstitute for Information processing (TNT), Leibniz University Hanover Appelstr. 9A, 30167 Hannover, GermanyInstitute for Information processing (TNT), Leibniz University Hanover Appelstr. 9A, 30167 Hannover, GermanyWe present an interactive system to manipulate a virtual object by tracking multiple hands in 3D space using a Kinect device. The system segments hand shapes from a captured 3D scene by using depth information and active contours. A hand shape is recognized by a trained naive Bayes classifier, whether it belongs to a palm, a pointing hand form or both hands with simple occlusion. A plane is approximated by using RANSAC for a palm hand form, while a vector from the hand centroid to the fingertip is obtained for a pointing hand form by using ICP as tracking method. A shape of simple occluded two hands is split into a palm and an incomplete pointing hand form, whose missing data is estimated by using PCA. The system works in semi-real time.http://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/II-3-W2/19/2013/isprsannals-II-3-W2-19-2013.pdf |
| spellingShingle | Y. Guo M. Ying Yang B. Rosenhahn Interactive multi-object tracking for virtual object manipulation ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | Interactive multi-object tracking for virtual object manipulation |
| title_full | Interactive multi-object tracking for virtual object manipulation |
| title_fullStr | Interactive multi-object tracking for virtual object manipulation |
| title_full_unstemmed | Interactive multi-object tracking for virtual object manipulation |
| title_short | Interactive multi-object tracking for virtual object manipulation |
| title_sort | interactive multi object tracking for virtual object manipulation |
| url | http://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/II-3-W2/19/2013/isprsannals-II-3-W2-19-2013.pdf |
| work_keys_str_mv | AT yguo interactivemultiobjecttrackingforvirtualobjectmanipulation AT myingyang interactivemultiobjecttrackingforvirtualobjectmanipulation AT brosenhahn interactivemultiobjecttrackingforvirtualobjectmanipulation |