Cost Efficient Virtual Environment Generation Framework Using Annotated Panoramic Videos
In this paper, we introduce a cost-efficient framework that renders a realistic representation of a physical environment using panoramic videos. The framework includes the following main modules: 1) video capturing and stitching, 2) camera trajectory estimation in the panoramic video using computer...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2019-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8815716/ |
| _version_ | 1819276306083217408 |
|---|---|
| author | Hao Dong Aura Ganz |
| author_facet | Hao Dong Aura Ganz |
| author_sort | Hao Dong |
| collection | DOAJ |
| description | In this paper, we introduce a cost-efficient framework that renders a realistic representation of a physical environment using panoramic videos. The framework includes the following main modules: 1) video capturing and stitching, 2) camera trajectory estimation in the panoramic video using computer vision techniques, and 3) generation of virtual experiences using annotations that are integrated into the panoramic video. To quantify the framework performance in terms of processing time, we conducted experiments in three different large environments using a 3.5GHz desktop computer for processing. We show that the proposed framework processing time is less than a minute per meter of the recorded path in the physical environment which is a significant reduction compared to traditional 3D modeling approaches. While the cost savings are substantial, the framework enables the users to explore the virtual environment only along the recorded paths. The proposed framework provides an opportunity to develop applications (e.g. simulation-based training) with limited budgets and still meet the requirement of a very accurate representation of the physical indoor environment. |
| first_indexed | 2024-12-23T23:38:07Z |
| format | Article |
| id | doaj.art-c3e143f302c3473591bddb76ffeae487 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-23T23:38:07Z |
| publishDate | 2019-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-c3e143f302c3473591bddb76ffeae4872022-12-21T17:25:50ZengIEEEIEEE Access2169-35362019-01-01712102412103610.1109/ACCESS.2019.29378778815716Cost Efficient Virtual Environment Generation Framework Using Annotated Panoramic VideosHao Dong0https://orcid.org/0000-0001-9741-1612Aura Ganz1https://orcid.org/0000-0002-7526-6343Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USADepartment of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USAIn this paper, we introduce a cost-efficient framework that renders a realistic representation of a physical environment using panoramic videos. The framework includes the following main modules: 1) video capturing and stitching, 2) camera trajectory estimation in the panoramic video using computer vision techniques, and 3) generation of virtual experiences using annotations that are integrated into the panoramic video. To quantify the framework performance in terms of processing time, we conducted experiments in three different large environments using a 3.5GHz desktop computer for processing. We show that the proposed framework processing time is less than a minute per meter of the recorded path in the physical environment which is a significant reduction compared to traditional 3D modeling approaches. While the cost savings are substantial, the framework enables the users to explore the virtual environment only along the recorded paths. The proposed framework provides an opportunity to develop applications (e.g. simulation-based training) with limited budgets and still meet the requirement of a very accurate representation of the physical indoor environment.https://ieeexplore.ieee.org/document/8815716/Virtual realitypanoramic videoSLAM |
| spellingShingle | Hao Dong Aura Ganz Cost Efficient Virtual Environment Generation Framework Using Annotated Panoramic Videos IEEE Access Virtual reality panoramic video SLAM |
| title | Cost Efficient Virtual Environment Generation Framework Using Annotated Panoramic Videos |
| title_full | Cost Efficient Virtual Environment Generation Framework Using Annotated Panoramic Videos |
| title_fullStr | Cost Efficient Virtual Environment Generation Framework Using Annotated Panoramic Videos |
| title_full_unstemmed | Cost Efficient Virtual Environment Generation Framework Using Annotated Panoramic Videos |
| title_short | Cost Efficient Virtual Environment Generation Framework Using Annotated Panoramic Videos |
| title_sort | cost efficient virtual environment generation framework using annotated panoramic videos |
| topic | Virtual reality panoramic video SLAM |
| url | https://ieeexplore.ieee.org/document/8815716/ |
| work_keys_str_mv | AT haodong costefficientvirtualenvironmentgenerationframeworkusingannotatedpanoramicvideos AT auraganz costefficientvirtualenvironmentgenerationframeworkusingannotatedpanoramicvideos |