A handle bar metaphor for virtual object manipulation with mid-air interaction
Commercial 3D scene acquisition systems such as the Microsoft Kinect sensor can reduce the cost barrier of realizing mid-air interaction. However, since it can only sense hand position but not hand orientation robustly, current mid-air interaction methods for 3D virtual object manipulation often req...
| Main Authors: | , , , , |
|---|---|
| Other Authors: | |
| Format: | Conference Paper |
| Language: | English |
| Published: |
2013
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/96996 http://hdl.handle.net/10220/13156 |
| _version_ | 1826120135301136384 |
|---|---|
| author | Song, Peng Goh, Wooi Boon Liu, Xiaopei Hutama, William Fu, Chi-Wing |
| author2 | School of Computer Engineering |
| author_facet | School of Computer Engineering Song, Peng Goh, Wooi Boon Liu, Xiaopei Hutama, William Fu, Chi-Wing |
| author_sort | Song, Peng |
| collection | NTU |
| description | Commercial 3D scene acquisition systems such as the Microsoft Kinect sensor can reduce the cost barrier of realizing mid-air interaction. However, since it can only sense hand position but not hand orientation robustly, current mid-air interaction methods for 3D virtual object manipulation often require contextual and mode switching to perform translation, rotation, and scaling, thus preventing natural continuous gestural interactions. A novel handle bar metaphor is proposed as an effective visual control metaphor between the user's hand gestures and the corresponding virtual object manipulation operations. It mimics a familiar situation of handling objects that are skewered with a bimanual handle bar. The use of relative 3D motion of the two hands to design the mid-air interaction allows us to provide precise controllability despite the Kinect sensor's low image resolution. A comprehensive repertoire of 3D manipulation operations is proposed to manipulate single objects, perform fast constrained rotation, and pack/align multiple objects along a line. Three user studies were devised to demonstrate the efficacy and intuitiveness of the proposed interaction techniques on different virtual manipulation scenarios. |
| first_indexed | 2024-10-01T05:11:34Z |
| format | Conference Paper |
| id | ntu-10356/96996 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T05:11:34Z |
| publishDate | 2013 |
| record_format | dspace |
| spelling | ntu-10356/969962020-05-28T07:17:50Z A handle bar metaphor for virtual object manipulation with mid-air interaction Song, Peng Goh, Wooi Boon Liu, Xiaopei Hutama, William Fu, Chi-Wing School of Computer Engineering Conference on Human Factors in Computing Systems (2012 : Austin, USA) DRNTU::Engineering::Computer science and engineering Commercial 3D scene acquisition systems such as the Microsoft Kinect sensor can reduce the cost barrier of realizing mid-air interaction. However, since it can only sense hand position but not hand orientation robustly, current mid-air interaction methods for 3D virtual object manipulation often require contextual and mode switching to perform translation, rotation, and scaling, thus preventing natural continuous gestural interactions. A novel handle bar metaphor is proposed as an effective visual control metaphor between the user's hand gestures and the corresponding virtual object manipulation operations. It mimics a familiar situation of handling objects that are skewered with a bimanual handle bar. The use of relative 3D motion of the two hands to design the mid-air interaction allows us to provide precise controllability despite the Kinect sensor's low image resolution. A comprehensive repertoire of 3D manipulation operations is proposed to manipulate single objects, perform fast constrained rotation, and pack/align multiple objects along a line. Three user studies were devised to demonstrate the efficacy and intuitiveness of the proposed interaction techniques on different virtual manipulation scenarios. 2013-08-16T04:01:52Z 2019-12-06T19:37:43Z 2013-08-16T04:01:52Z 2019-12-06T19:37:43Z 2012 2012 Conference Paper Song, P., Goh, W. B., Hutama, W., Fu, C. W.,& Liu, X. (2012). A handle bar metaphor for virtual object manipulation with mid-air interaction. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12. https://hdl.handle.net/10356/96996 http://hdl.handle.net/10220/13156 10.1145/2207676.2208585 en |
| spellingShingle | DRNTU::Engineering::Computer science and engineering Song, Peng Goh, Wooi Boon Liu, Xiaopei Hutama, William Fu, Chi-Wing A handle bar metaphor for virtual object manipulation with mid-air interaction |
| title | A handle bar metaphor for virtual object manipulation with mid-air interaction |
| title_full | A handle bar metaphor for virtual object manipulation with mid-air interaction |
| title_fullStr | A handle bar metaphor for virtual object manipulation with mid-air interaction |
| title_full_unstemmed | A handle bar metaphor for virtual object manipulation with mid-air interaction |
| title_short | A handle bar metaphor for virtual object manipulation with mid-air interaction |
| title_sort | handle bar metaphor for virtual object manipulation with mid air interaction |
| topic | DRNTU::Engineering::Computer science and engineering |
| url | https://hdl.handle.net/10356/96996 http://hdl.handle.net/10220/13156 |
| work_keys_str_mv | AT songpeng ahandlebarmetaphorforvirtualobjectmanipulationwithmidairinteraction AT gohwooiboon ahandlebarmetaphorforvirtualobjectmanipulationwithmidairinteraction AT liuxiaopei ahandlebarmetaphorforvirtualobjectmanipulationwithmidairinteraction AT hutamawilliam ahandlebarmetaphorforvirtualobjectmanipulationwithmidairinteraction AT fuchiwing ahandlebarmetaphorforvirtualobjectmanipulationwithmidairinteraction AT songpeng handlebarmetaphorforvirtualobjectmanipulationwithmidairinteraction AT gohwooiboon handlebarmetaphorforvirtualobjectmanipulationwithmidairinteraction AT liuxiaopei handlebarmetaphorforvirtualobjectmanipulationwithmidairinteraction AT hutamawilliam handlebarmetaphorforvirtualobjectmanipulationwithmidairinteraction AT fuchiwing handlebarmetaphorforvirtualobjectmanipulationwithmidairinteraction |