Human activity detection and action recognition in videos using convolutional neural networks
Human activity recognition from video scenes has become a significant area of research in the field of computer vision applications. Action recognition is one of the most challenging problems in the area of video analysis and it finds applications in human-computer interaction, anomalous activity de...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Universiti Utara Malaysia
2020
|
| Subjects: | |
| Online Access: | https://repo.uum.edu.my/id/eprint/26940/1/JICT%20%2019%202%202020%20157-183.pdf |
| _version_ | 1803629218457714688 |
|---|---|
| author | Basavaiah, Jagadeesh Patil, Chandrashekar Mohan |
| author_facet | Basavaiah, Jagadeesh Patil, Chandrashekar Mohan |
| author_sort | Basavaiah, Jagadeesh |
| collection | UUM |
| description | Human activity recognition from video scenes has become a significant area of research in the field of computer vision applications. Action recognition is one of the most challenging problems in the area of video analysis and it finds applications in human-computer interaction, anomalous activity detection, crowd monitoring and patient monitoring. Several approaches have been presented for human activity recognition using machine learning techniques. The main aim of this work is to detect and track human activity, and classify actions for two publicly available video databases. In this work, a novel approach of feature extraction from video sequence by combining Scale Invariant Feature Transform and optical flow computation are used where shape, gradient and orientation features are also incorporated for robust feature formulation. Tracking of human activity in the video is implemented using the Gaussian Mixture Model. Convolutional Neural Network based classification approach is used for database training and testing purposes. The activity recognition performance is evaluated for two public datasets namely Weizmann dataset and Kungliga Tekniska Hogskolan dataset with action recognition accuracy of 98.43% and 94.96%, respectively. Experimental and comparative studies have shown that the proposed approach outperformed state-of the art techniques. |
| first_indexed | 2024-07-04T06:34:21Z |
| format | Article |
| id | uum-26940 |
| institution | Universiti Utara Malaysia |
| language | English |
| last_indexed | 2024-07-04T06:34:21Z |
| publishDate | 2020 |
| publisher | Universiti Utara Malaysia |
| record_format | dspace |
| spelling | uum-269402020-04-20T05:11:14Z https://repo.uum.edu.my/id/eprint/26940/ Human activity detection and action recognition in videos using convolutional neural networks Basavaiah, Jagadeesh Patil, Chandrashekar Mohan QA76 Computer software Human activity recognition from video scenes has become a significant area of research in the field of computer vision applications. Action recognition is one of the most challenging problems in the area of video analysis and it finds applications in human-computer interaction, anomalous activity detection, crowd monitoring and patient monitoring. Several approaches have been presented for human activity recognition using machine learning techniques. The main aim of this work is to detect and track human activity, and classify actions for two publicly available video databases. In this work, a novel approach of feature extraction from video sequence by combining Scale Invariant Feature Transform and optical flow computation are used where shape, gradient and orientation features are also incorporated for robust feature formulation. Tracking of human activity in the video is implemented using the Gaussian Mixture Model. Convolutional Neural Network based classification approach is used for database training and testing purposes. The activity recognition performance is evaluated for two public datasets namely Weizmann dataset and Kungliga Tekniska Hogskolan dataset with action recognition accuracy of 98.43% and 94.96%, respectively. Experimental and comparative studies have shown that the proposed approach outperformed state-of the art techniques. Universiti Utara Malaysia 2020 Article PeerReviewed application/pdf en https://repo.uum.edu.my/id/eprint/26940/1/JICT%20%2019%202%202020%20157-183.pdf Basavaiah, Jagadeesh and Patil, Chandrashekar Mohan (2020) Human activity detection and action recognition in videos using convolutional neural networks. Journal of Information and Communication Technology (JICT), 19 (2). pp. 157-183. ISSN 1675-414X http://jict.uum.edu.my/index.php/currentissues#a1 |
| spellingShingle | QA76 Computer software Basavaiah, Jagadeesh Patil, Chandrashekar Mohan Human activity detection and action recognition in videos using convolutional neural networks |
| title | Human activity detection and action recognition in videos using convolutional neural networks |
| title_full | Human activity detection and action recognition in videos using convolutional neural networks |
| title_fullStr | Human activity detection and action recognition in videos using convolutional neural networks |
| title_full_unstemmed | Human activity detection and action recognition in videos using convolutional neural networks |
| title_short | Human activity detection and action recognition in videos using convolutional neural networks |
| title_sort | human activity detection and action recognition in videos using convolutional neural networks |
| topic | QA76 Computer software |
| url | https://repo.uum.edu.my/id/eprint/26940/1/JICT%20%2019%202%202020%20157-183.pdf |
| work_keys_str_mv | AT basavaiahjagadeesh humanactivitydetectionandactionrecognitioninvideosusingconvolutionalneuralnetworks AT patilchandrashekarmohan humanactivitydetectionandactionrecognitioninvideosusingconvolutionalneuralnetworks |