The Detection of Video Shot Transitions Based on Primary Segments Using the Adaptive Threshold of Colour-Based Histogram Differences and Candidate Segments Using the SURF Feature Descriptor
Aim: Advancements in multimedia technology have facilitated the uploading and processing of videos with substantial content. Automated tools and techniques help to manage vast volumes of video content. Video shot segmentation is the basic symmetry step underlying video processing techniques such as...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-09-01
|
| Series: | Symmetry |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2073-8994/14/10/2041 |
| _version_ | 1797469822243569664 |
|---|---|
| author | Raja Suguna M. Kalaivani A. Anusuya S. |
| author_facet | Raja Suguna M. Kalaivani A. Anusuya S. |
| author_sort | Raja Suguna M. |
| collection | DOAJ |
| description | Aim: Advancements in multimedia technology have facilitated the uploading and processing of videos with substantial content. Automated tools and techniques help to manage vast volumes of video content. Video shot segmentation is the basic symmetry step underlying video processing techniques such as video indexing, content-based video retrieval, video summarization, and intelligent surveillance. Video shot boundary detection segments a video into temporal segments called shots and identifies the video frame in which a shot change occurs. The two types of shot transitions are cut and gradual. Illumination changes, camera motion, and fast-moving objects in videos reduce the detection accuracy of cut and gradual transitions. Materials and Methods: In this paper, a novel symmetry shot boundary detection system is proposed to maximize detection accuracy by analysing the transition behaviour of a video, segmenting it initially into primary segments and candidate segments by using the colour feature and the local adaptive threshold of each segment. Thereafter, the cut and gradual transitions are fine-tuned from the candidate segment using Speeded-Up Robust Features (SURF) extracted from the boundary frames to reduce the algorithmic complexity. The proposed symmetry method is evaluated using the TRECVID 2001 video dataset, and the results show an increase in detection accuracy. Result: The F1 score obtained for the detection of cut and gradual transitions is 98.7% and 90.8%, respectively. Conclusions: The proposed symmetry method surpasses recent state-of-the-art SBD methods, demonstrating increased accuracy for both cut and gradual transitions in videos. |
| first_indexed | 2024-03-09T19:26:30Z |
| format | Article |
| id | doaj.art-1261efffa2744499b23d0c311a9f6e60 |
| institution | Directory Open Access Journal |
| issn | 2073-8994 |
| language | English |
| last_indexed | 2024-03-09T19:26:30Z |
| publishDate | 2022-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Symmetry |
| spelling | doaj.art-1261efffa2744499b23d0c311a9f6e602023-11-24T02:51:14ZengMDPI AGSymmetry2073-89942022-09-011410204110.3390/sym14102041The Detection of Video Shot Transitions Based on Primary Segments Using the Adaptive Threshold of Colour-Based Histogram Differences and Candidate Segments Using the SURF Feature DescriptorRaja Suguna M.0Kalaivani A.1Anusuya S.2Department of Computer Science and Engineering, RMK College of Engineering and Technology, Chennai 600095, IndiaDepartment of Information and Technology, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai 600095, IndiaDepartment of Information and Technology, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai 600095, IndiaAim: Advancements in multimedia technology have facilitated the uploading and processing of videos with substantial content. Automated tools and techniques help to manage vast volumes of video content. Video shot segmentation is the basic symmetry step underlying video processing techniques such as video indexing, content-based video retrieval, video summarization, and intelligent surveillance. Video shot boundary detection segments a video into temporal segments called shots and identifies the video frame in which a shot change occurs. The two types of shot transitions are cut and gradual. Illumination changes, camera motion, and fast-moving objects in videos reduce the detection accuracy of cut and gradual transitions. Materials and Methods: In this paper, a novel symmetry shot boundary detection system is proposed to maximize detection accuracy by analysing the transition behaviour of a video, segmenting it initially into primary segments and candidate segments by using the colour feature and the local adaptive threshold of each segment. Thereafter, the cut and gradual transitions are fine-tuned from the candidate segment using Speeded-Up Robust Features (SURF) extracted from the boundary frames to reduce the algorithmic complexity. The proposed symmetry method is evaluated using the TRECVID 2001 video dataset, and the results show an increase in detection accuracy. Result: The F1 score obtained for the detection of cut and gradual transitions is 98.7% and 90.8%, respectively. Conclusions: The proposed symmetry method surpasses recent state-of-the-art SBD methods, demonstrating increased accuracy for both cut and gradual transitions in videos.https://www.mdpi.com/2073-8994/14/10/2041shot boundary detection (SBD)cut transitiongradual transitioncandidate segmentsSpeeded-Up Robust Feature (SURF)adaptive threshold |
| spellingShingle | Raja Suguna M. Kalaivani A. Anusuya S. The Detection of Video Shot Transitions Based on Primary Segments Using the Adaptive Threshold of Colour-Based Histogram Differences and Candidate Segments Using the SURF Feature Descriptor Symmetry shot boundary detection (SBD) cut transition gradual transition candidate segments Speeded-Up Robust Feature (SURF) adaptive threshold |
| title | The Detection of Video Shot Transitions Based on Primary Segments Using the Adaptive Threshold of Colour-Based Histogram Differences and Candidate Segments Using the SURF Feature Descriptor |
| title_full | The Detection of Video Shot Transitions Based on Primary Segments Using the Adaptive Threshold of Colour-Based Histogram Differences and Candidate Segments Using the SURF Feature Descriptor |
| title_fullStr | The Detection of Video Shot Transitions Based on Primary Segments Using the Adaptive Threshold of Colour-Based Histogram Differences and Candidate Segments Using the SURF Feature Descriptor |
| title_full_unstemmed | The Detection of Video Shot Transitions Based on Primary Segments Using the Adaptive Threshold of Colour-Based Histogram Differences and Candidate Segments Using the SURF Feature Descriptor |
| title_short | The Detection of Video Shot Transitions Based on Primary Segments Using the Adaptive Threshold of Colour-Based Histogram Differences and Candidate Segments Using the SURF Feature Descriptor |
| title_sort | detection of video shot transitions based on primary segments using the adaptive threshold of colour based histogram differences and candidate segments using the surf feature descriptor |
| topic | shot boundary detection (SBD) cut transition gradual transition candidate segments Speeded-Up Robust Feature (SURF) adaptive threshold |
| url | https://www.mdpi.com/2073-8994/14/10/2041 |
| work_keys_str_mv | AT rajasugunam thedetectionofvideoshottransitionsbasedonprimarysegmentsusingtheadaptivethresholdofcolourbasedhistogramdifferencesandcandidatesegmentsusingthesurffeaturedescriptor AT kalaivania thedetectionofvideoshottransitionsbasedonprimarysegmentsusingtheadaptivethresholdofcolourbasedhistogramdifferencesandcandidatesegmentsusingthesurffeaturedescriptor AT anusuyas thedetectionofvideoshottransitionsbasedonprimarysegmentsusingtheadaptivethresholdofcolourbasedhistogramdifferencesandcandidatesegmentsusingthesurffeaturedescriptor AT rajasugunam detectionofvideoshottransitionsbasedonprimarysegmentsusingtheadaptivethresholdofcolourbasedhistogramdifferencesandcandidatesegmentsusingthesurffeaturedescriptor AT kalaivania detectionofvideoshottransitionsbasedonprimarysegmentsusingtheadaptivethresholdofcolourbasedhistogramdifferencesandcandidatesegmentsusingthesurffeaturedescriptor AT anusuyas detectionofvideoshottransitionsbasedonprimarysegmentsusingtheadaptivethresholdofcolourbasedhistogramdifferencesandcandidatesegmentsusingthesurffeaturedescriptor |