An Ontology for Spatio-Temporal Media Management and an Interactive Application
In addition to traditional viewing media, metadata that record the physical space from multiple perspectives will become extremely important in realizing interactive applications such as Virtual Reality (VR) and Augmented Reality (AR). This paper proposes the Software Defined Media (SDM) Ontology de...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-06-01
|
| Series: | Future Internet |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1999-5903/15/7/225 |
| _version_ | 1797589220581179392 |
|---|---|
| author | Takuro Sone Shin Kato Ray Atarashi Jin Nakazato Manabu Tsukada Hiroshi Esaki |
| author_facet | Takuro Sone Shin Kato Ray Atarashi Jin Nakazato Manabu Tsukada Hiroshi Esaki |
| author_sort | Takuro Sone |
| collection | DOAJ |
| description | In addition to traditional viewing media, metadata that record the physical space from multiple perspectives will become extremely important in realizing interactive applications such as Virtual Reality (VR) and Augmented Reality (AR). This paper proposes the Software Defined Media (SDM) Ontology designed to describe spatio-temporal media and the systems that handle them comprehensively. Spatio-temporal media refers to video, audio, and various sensor values recorded together with time and location information. The SDM Ontology can flexibly and precisely represent spatio-temporal media, equipment, and functions that record, process, edit, and play them, as well as related semantic information. In addition, we recorded classical and jazz concerts using many video cameras and audio microphones, and then processed and edited the video and audio data with related metadata. Then, we created a dataset using the SDM Ontology and published it as linked open data (LOD). Furthermore, we developed “Web<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msup><mn>360</mn><mn>2</mn></msup></semantics></math></inline-formula>”, an application that enables users to interactively view and experience <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msup><mn>360</mn><mo>∘</mo></msup></semantics></math></inline-formula> video and spatial acoustic sounds by referring to this dataset. We conducted a subjective evaluation by using a user questionnaire. Web<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msup><mn>360</mn><mn>2</mn></msup></semantics></math></inline-formula> is a data-driven web application that obtains video and audio data and related metadata by querying the dataset. |
| first_indexed | 2024-03-11T01:03:25Z |
| format | Article |
| id | doaj.art-219789e0c19845088bbda30ae3cba9ce |
| institution | Directory Open Access Journal |
| issn | 1999-5903 |
| language | English |
| last_indexed | 2024-03-11T01:03:25Z |
| publishDate | 2023-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Future Internet |
| spelling | doaj.art-219789e0c19845088bbda30ae3cba9ce2023-11-18T19:26:42ZengMDPI AGFuture Internet1999-59032023-06-0115722510.3390/fi15070225An Ontology for Spatio-Temporal Media Management and an Interactive ApplicationTakuro Sone0Shin Kato1Ray Atarashi2Jin Nakazato3Manabu Tsukada4Hiroshi Esaki5Graduate School of Science and Technology, Shizuoka University, Hamamatsu 432-8011, Shizuoka, JapanGraduate School of Information Science and Technology, Department of Creative Informatics, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, JapanInternet Initiative Japan Inc., Chiyoda-ku, Tokyo 102-0071, JapanGraduate School of Information Science and Technology, Department of Creative Informatics, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, JapanGraduate School of Information Science and Technology, Department of Creative Informatics, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, JapanGraduate School of Information Science and Technology, Department of Creative Informatics, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, JapanIn addition to traditional viewing media, metadata that record the physical space from multiple perspectives will become extremely important in realizing interactive applications such as Virtual Reality (VR) and Augmented Reality (AR). This paper proposes the Software Defined Media (SDM) Ontology designed to describe spatio-temporal media and the systems that handle them comprehensively. Spatio-temporal media refers to video, audio, and various sensor values recorded together with time and location information. The SDM Ontology can flexibly and precisely represent spatio-temporal media, equipment, and functions that record, process, edit, and play them, as well as related semantic information. In addition, we recorded classical and jazz concerts using many video cameras and audio microphones, and then processed and edited the video and audio data with related metadata. Then, we created a dataset using the SDM Ontology and published it as linked open data (LOD). Furthermore, we developed “Web<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msup><mn>360</mn><mn>2</mn></msup></semantics></math></inline-formula>”, an application that enables users to interactively view and experience <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msup><mn>360</mn><mo>∘</mo></msup></semantics></math></inline-formula> video and spatial acoustic sounds by referring to this dataset. We conducted a subjective evaluation by using a user questionnaire. Web<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msup><mn>360</mn><mn>2</mn></msup></semantics></math></inline-formula> is a data-driven web application that obtains video and audio data and related metadata by querying the dataset.https://www.mdpi.com/1999-5903/15/7/225content managementontologyresource description frameworkdigital mediaaudio visualproof-of-concept |
| spellingShingle | Takuro Sone Shin Kato Ray Atarashi Jin Nakazato Manabu Tsukada Hiroshi Esaki An Ontology for Spatio-Temporal Media Management and an Interactive Application Future Internet content management ontology resource description framework digital media audio visual proof-of-concept |
| title | An Ontology for Spatio-Temporal Media Management and an Interactive Application |
| title_full | An Ontology for Spatio-Temporal Media Management and an Interactive Application |
| title_fullStr | An Ontology for Spatio-Temporal Media Management and an Interactive Application |
| title_full_unstemmed | An Ontology for Spatio-Temporal Media Management and an Interactive Application |
| title_short | An Ontology for Spatio-Temporal Media Management and an Interactive Application |
| title_sort | ontology for spatio temporal media management and an interactive application |
| topic | content management ontology resource description framework digital media audio visual proof-of-concept |
| url | https://www.mdpi.com/1999-5903/15/7/225 |
| work_keys_str_mv | AT takurosone anontologyforspatiotemporalmediamanagementandaninteractiveapplication AT shinkato anontologyforspatiotemporalmediamanagementandaninteractiveapplication AT rayatarashi anontologyforspatiotemporalmediamanagementandaninteractiveapplication AT jinnakazato anontologyforspatiotemporalmediamanagementandaninteractiveapplication AT manabutsukada anontologyforspatiotemporalmediamanagementandaninteractiveapplication AT hiroshiesaki anontologyforspatiotemporalmediamanagementandaninteractiveapplication AT takurosone ontologyforspatiotemporalmediamanagementandaninteractiveapplication AT shinkato ontologyforspatiotemporalmediamanagementandaninteractiveapplication AT rayatarashi ontologyforspatiotemporalmediamanagementandaninteractiveapplication AT jinnakazato ontologyforspatiotemporalmediamanagementandaninteractiveapplication AT manabutsukada ontologyforspatiotemporalmediamanagementandaninteractiveapplication AT hiroshiesaki ontologyforspatiotemporalmediamanagementandaninteractiveapplication |