Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning Techniques
Augmented Reality (AR) is a class of “mediated reality” that artificially modifies the human perception by superimposing virtual objects on the real world, which is expected to supplement reality. In visual-based augmentation, text and graphics, i.e., label, are often associated with a physical obje...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2019-02-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/19/4/939 |
| _version_ | 1818039542561636352 |
|---|---|
| author | Keita Ichihashi Kaori Fujinami |
| author_facet | Keita Ichihashi Kaori Fujinami |
| author_sort | Keita Ichihashi |
| collection | DOAJ |
| description | Augmented Reality (AR) is a class of “mediated reality” that artificially modifies the human perception by superimposing virtual objects on the real world, which is expected to supplement reality. In visual-based augmentation, text and graphics, i.e., label, are often associated with a physical object or a place to describe it. View management in AR is to maintain the visibility of the associated information and plays an important role on communicating the information. Various view management techniques have been investigated so far; however, most of them have been designed for two dimensional see-through displays, and few have been investigated for projector-based AR called spatial AR. In this article, we propose a view management method for spatial AR, VisLP, that places labels and linkage lines based on the estimation of the visibility. Since the information is directly projected on objects, the nature of optics such as reflection and refraction constrains the visibility in addition to the spatial relationship between the information, the objects, and the user. VisLP employs machine-learning techniques to estimate the visibility that reflects human’s subjective mental workload in reading information and objective measures of reading correctness in various projection conditions. Four classes are defined for a label, while the visibility of a linkage line has three classes. After 88 and 28 classification features for label and linkage line visibility estimators are designed, respectively, subsets of features with 15 and 14 features are chosen to improve the processing speed of feature calculation up to 170%, with slight degradation of classification performance. An online experiment with new users and objects showed that 76.0% of the system’s judgments were matched with the users’ evaluations, while 73% of the linkage line visibility estimations were matched. |
| first_indexed | 2024-12-10T08:00:17Z |
| format | Article |
| id | doaj.art-f5e1f13cbb43404d8f0d23d861706c7e |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-12-10T08:00:17Z |
| publishDate | 2019-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-f5e1f13cbb43404d8f0d23d861706c7e2022-12-22T01:56:49ZengMDPI AGSensors1424-82202019-02-0119493910.3390/s19040939s19040939Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning TechniquesKeita Ichihashi0Kaori Fujinami1Department of Computer and Information Sciences, Tokyo University of Agriculture and Technology, Tokyo 184-8588, JapanDepartment of Computer and Information Sciences, Tokyo University of Agriculture and Technology, Tokyo 184-8588, JapanAugmented Reality (AR) is a class of “mediated reality” that artificially modifies the human perception by superimposing virtual objects on the real world, which is expected to supplement reality. In visual-based augmentation, text and graphics, i.e., label, are often associated with a physical object or a place to describe it. View management in AR is to maintain the visibility of the associated information and plays an important role on communicating the information. Various view management techniques have been investigated so far; however, most of them have been designed for two dimensional see-through displays, and few have been investigated for projector-based AR called spatial AR. In this article, we propose a view management method for spatial AR, VisLP, that places labels and linkage lines based on the estimation of the visibility. Since the information is directly projected on objects, the nature of optics such as reflection and refraction constrains the visibility in addition to the spatial relationship between the information, the objects, and the user. VisLP employs machine-learning techniques to estimate the visibility that reflects human’s subjective mental workload in reading information and objective measures of reading correctness in various projection conditions. Four classes are defined for a label, while the visibility of a linkage line has three classes. After 88 and 28 classification features for label and linkage line visibility estimators are designed, respectively, subsets of features with 15 and 14 features are chosen to improve the processing speed of feature calculation up to 170%, with slight degradation of classification performance. An online experiment with new users and objects showed that 76.0% of the system’s judgments were matched with the users’ evaluations, while 73% of the linkage line visibility estimations were matched.https://www.mdpi.com/1424-8220/19/4/939mediated realitymodified perceptionaugmented realityspatial augmented realityview managementannotationprojectormachine-learningfeature selectiondepth sensing |
| spellingShingle | Keita Ichihashi Kaori Fujinami Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning Techniques Sensors mediated reality modified perception augmented reality spatial augmented reality view management annotation projector machine-learning feature selection depth sensing |
| title | Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning Techniques |
| title_full | Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning Techniques |
| title_fullStr | Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning Techniques |
| title_full_unstemmed | Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning Techniques |
| title_short | Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning Techniques |
| title_sort | estimating visibility of annotations for view management in spatial augmented reality based on machine learning techniques |
| topic | mediated reality modified perception augmented reality spatial augmented reality view management annotation projector machine-learning feature selection depth sensing |
| url | https://www.mdpi.com/1424-8220/19/4/939 |
| work_keys_str_mv | AT keitaichihashi estimatingvisibilityofannotationsforviewmanagementinspatialaugmentedrealitybasedonmachinelearningtechniques AT kaorifujinami estimatingvisibilityofannotationsforviewmanagementinspatialaugmentedrealitybasedonmachinelearningtechniques |