Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach
To produce a realistic augmentation in Augmented Reality, the correct relative positions of real objects and virtual objects are very important. In this paper, we propose a novel real-time occlusion handling method based on an object tracking approach. Our method is divided into three steps: selecti...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2010-03-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1424-8220/10/4/2885/ |
| _version_ | 1798042326582427648 |
|---|---|
| author | Yuan Tian Tao Guan Cheng Wang |
| author_facet | Yuan Tian Tao Guan Cheng Wang |
| author_sort | Yuan Tian |
| collection | DOAJ |
| description | To produce a realistic augmentation in Augmented Reality, the correct relative positions of real objects and virtual objects are very important. In this paper, we propose a novel real-time occlusion handling method based on an object tracking approach. Our method is divided into three steps: selection of the occluding object, object tracking and occlusion handling. The user selects the occluding object using an interactive segmentation method. The contour of the selected object is then tracked in the subsequent frames in real-time. In the occlusion handling step, all the pixels on the tracked object are redrawn on the unprocessed augmented image to produce a new synthesized image in which the relative position between the real and virtual object is correct. The proposed method has several advantages. First, it is robust and stable, since it remains effective when the camera is moved through large changes of viewing angles and volumes or when the object and the background have similar colors. Second, it is fast, since the real object can be tracked in real-time. Last, a smoothing technique provides seamless merging between the augmented and virtual object. Several experiments are provided to validate the performance of the proposed method. |
| first_indexed | 2024-04-11T22:34:01Z |
| format | Article |
| id | doaj.art-7ef91644a68e47e59f3f825db862ec74 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-04-11T22:34:01Z |
| publishDate | 2010-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-7ef91644a68e47e59f3f825db862ec742022-12-22T03:59:16ZengMDPI AGSensors1424-82202010-03-011042885290010.3390/s100402885Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking ApproachYuan TianTao GuanCheng WangTo produce a realistic augmentation in Augmented Reality, the correct relative positions of real objects and virtual objects are very important. In this paper, we propose a novel real-time occlusion handling method based on an object tracking approach. Our method is divided into three steps: selection of the occluding object, object tracking and occlusion handling. The user selects the occluding object using an interactive segmentation method. The contour of the selected object is then tracked in the subsequent frames in real-time. In the occlusion handling step, all the pixels on the tracked object are redrawn on the unprocessed augmented image to produce a new synthesized image in which the relative position between the real and virtual object is correct. The proposed method has several advantages. First, it is robust and stable, since it remains effective when the camera is moved through large changes of viewing angles and volumes or when the object and the background have similar colors. Second, it is fast, since the real object can be tracked in real-time. Last, a smoothing technique provides seamless merging between the augmented and virtual object. Several experiments are provided to validate the performance of the proposed method.http://www.mdpi.com/1424-8220/10/4/2885/augmented realityocclusiontrackingmean shiftoptical flowgraph cuts |
| spellingShingle | Yuan Tian Tao Guan Cheng Wang Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach Sensors augmented reality occlusion tracking mean shift optical flow graph cuts |
| title | Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach |
| title_full | Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach |
| title_fullStr | Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach |
| title_full_unstemmed | Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach |
| title_short | Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach |
| title_sort | real time occlusion handling in augmented reality based on an object tracking approach |
| topic | augmented reality occlusion tracking mean shift optical flow graph cuts |
| url | http://www.mdpi.com/1424-8220/10/4/2885/ |
| work_keys_str_mv | AT yuantian realtimeocclusionhandlinginaugmentedrealitybasedonanobjecttrackingapproach AT taoguan realtimeocclusionhandlinginaugmentedrealitybasedonanobjecttrackingapproach AT chengwang realtimeocclusionhandlinginaugmentedrealitybasedonanobjecttrackingapproach |