An integrated semantic-based approach in concept based video retrieval
Multimedia content has been growing quickly and video retrieval is regarded as one of the most famous issues in multimedia research. In order to retrieve a desirable video, users express their needs in terms of queries. Queries can be on object, motion, texture, color, audio, etc. Low-level represen...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Springer New York LLC
2013
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/30554/1/An%20integrated%20semantic.pdf |
| _version_ | 1825947729732304896 |
|---|---|
| author | Memar, Sara Affendey, Lilly Suriani Mustapha, Norwati C. Doraisamy, Shyamala Ektefa, Mohammadreza |
| author_facet | Memar, Sara Affendey, Lilly Suriani Mustapha, Norwati C. Doraisamy, Shyamala Ektefa, Mohammadreza |
| author_sort | Memar, Sara |
| collection | UPM |
| description | Multimedia content has been growing quickly and video retrieval is regarded as one of the most famous issues in multimedia research. In order to retrieve a desirable video, users express their needs in terms of queries. Queries can be on object, motion, texture, color, audio, etc. Low-level representations of video are different from the higher level concepts which a user associates with video. Therefore, query based on semantics is more realistic and tangible for end user. Comprehending the semantics of query has opened a new insight in video retrieval and bridging the semantic gap. However, the problem is that the video needs to be manually annotated in order to support queries expressed in terms of semantic
concepts. Annotating semantic concepts which appear in video shots is a challenging and time-consuming task. Moreover, it is not possible to provide annotation for every
concept in the real world. In this study, an integrated semantic-based approach for similarity computation is proposed with respect to enhance the retrieval effectiveness
in concept-based video retrieval. The proposed method is based on the integration of knowledge-based and corpus-based semantic word similarity measures in order
to retrieve video shots for concepts whose annotations are not available for the system. The TRECVID 2005 dataset is used for evaluation purpose, and the results of applying proposed method are then compared against the individual knowledge-based and corpus-based semantic word similarity measures which were utilized in previous studies in the same domain. The superiority of integrated similarity method
is shown and evaluated in terms of Mean Average Precision (MAP). |
| first_indexed | 2024-03-06T08:17:55Z |
| format | Article |
| id | upm.eprints-30554 |
| institution | Universiti Putra Malaysia |
| language | English |
| last_indexed | 2024-03-06T08:17:55Z |
| publishDate | 2013 |
| publisher | Springer New York LLC |
| record_format | dspace |
| spelling | upm.eprints-305542015-10-07T07:58:36Z http://psasir.upm.edu.my/id/eprint/30554/ An integrated semantic-based approach in concept based video retrieval Memar, Sara Affendey, Lilly Suriani Mustapha, Norwati C. Doraisamy, Shyamala Ektefa, Mohammadreza Multimedia content has been growing quickly and video retrieval is regarded as one of the most famous issues in multimedia research. In order to retrieve a desirable video, users express their needs in terms of queries. Queries can be on object, motion, texture, color, audio, etc. Low-level representations of video are different from the higher level concepts which a user associates with video. Therefore, query based on semantics is more realistic and tangible for end user. Comprehending the semantics of query has opened a new insight in video retrieval and bridging the semantic gap. However, the problem is that the video needs to be manually annotated in order to support queries expressed in terms of semantic concepts. Annotating semantic concepts which appear in video shots is a challenging and time-consuming task. Moreover, it is not possible to provide annotation for every concept in the real world. In this study, an integrated semantic-based approach for similarity computation is proposed with respect to enhance the retrieval effectiveness in concept-based video retrieval. The proposed method is based on the integration of knowledge-based and corpus-based semantic word similarity measures in order to retrieve video shots for concepts whose annotations are not available for the system. The TRECVID 2005 dataset is used for evaluation purpose, and the results of applying proposed method are then compared against the individual knowledge-based and corpus-based semantic word similarity measures which were utilized in previous studies in the same domain. The superiority of integrated similarity method is shown and evaluated in terms of Mean Average Precision (MAP). Springer New York LLC 2013-05-01 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/30554/1/An%20integrated%20semantic.pdf Memar, Sara and Affendey, Lilly Suriani and Mustapha, Norwati and C. Doraisamy, Shyamala and Ektefa, Mohammadreza (2013) An integrated semantic-based approach in concept based video retrieval. Multimedia Tools and Applications, 64 (1). pp. 77-95. ISSN 1380-7501; ESSN: 1573-7721 10.1007/s11042-011-0848-4 |
| spellingShingle | Memar, Sara Affendey, Lilly Suriani Mustapha, Norwati C. Doraisamy, Shyamala Ektefa, Mohammadreza An integrated semantic-based approach in concept based video retrieval |
| title | An integrated semantic-based approach in concept based video retrieval
|
| title_full | An integrated semantic-based approach in concept based video retrieval
|
| title_fullStr | An integrated semantic-based approach in concept based video retrieval
|
| title_full_unstemmed | An integrated semantic-based approach in concept based video retrieval
|
| title_short | An integrated semantic-based approach in concept based video retrieval
|
| title_sort | integrated semantic based approach in concept based video retrieval |
| url | http://psasir.upm.edu.my/id/eprint/30554/1/An%20integrated%20semantic.pdf |
| work_keys_str_mv | AT memarsara anintegratedsemanticbasedapproachinconceptbasedvideoretrieval AT affendeylillysuriani anintegratedsemanticbasedapproachinconceptbasedvideoretrieval AT mustaphanorwati anintegratedsemanticbasedapproachinconceptbasedvideoretrieval AT cdoraisamyshyamala anintegratedsemanticbasedapproachinconceptbasedvideoretrieval AT ektefamohammadreza anintegratedsemanticbasedapproachinconceptbasedvideoretrieval AT memarsara integratedsemanticbasedapproachinconceptbasedvideoretrieval AT affendeylillysuriani integratedsemanticbasedapproachinconceptbasedvideoretrieval AT mustaphanorwati integratedsemanticbasedapproachinconceptbasedvideoretrieval AT cdoraisamyshyamala integratedsemanticbasedapproachinconceptbasedvideoretrieval AT ektefamohammadreza integratedsemanticbasedapproachinconceptbasedvideoretrieval |