Lightweight mobile network for real-time violence recognition
Most existing violence recognition methods have complex network structures and high cost of computation and cannot meet the requirements of large-scale deployment. The purpose of this paper is to reduce the complexity of the model to realize the application of violence recognition on mobile intellig...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2022-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9621415/?tool=EBI |
| _version_ | 1811244199069089792 |
|---|---|
| author | Youshan Zhang Yong Li Shaozhe Guo |
| author_facet | Youshan Zhang Yong Li Shaozhe Guo |
| author_sort | Youshan Zhang |
| collection | DOAJ |
| description | Most existing violence recognition methods have complex network structures and high cost of computation and cannot meet the requirements of large-scale deployment. The purpose of this paper is to reduce the complexity of the model to realize the application of violence recognition on mobile intelligent terminals. To solve this problem, we propose MobileNet-TSM, a lightweight network, which uses MobileNet-V2 as main structure. By incorporating temporal shift modules (TSM), which can exchange information between frames, the capability of extracting dynamic characteristics between consecutive frames is strengthened. Extensive experiments are conducted to prove the validity of this method. Our proposed model has only 8.49MB parameters and 175.86MB estimated total size. Compared with the existing methods, this method greatly reduced the model size, at the cost of an accuracy gap of about 3%. The proposed model has achieved accuracy of 97.959%, 97.5% and 87.75% on three public datasets (Crowd Violence, Hockey Fights, and RWF-2000), respectively. Based on this, we also build a real-time violence recognition application on the Android terminal. The source code and trained models are available on https://github.com/1840210289/MobileNet-TSM.git. |
| first_indexed | 2024-04-12T14:21:49Z |
| format | Article |
| id | doaj.art-47364872b65b4fe9859381324021d141 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-04-12T14:21:49Z |
| publishDate | 2022-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-47364872b65b4fe9859381324021d1412022-12-22T03:29:33ZengPublic Library of Science (PLoS)PLoS ONE1932-62032022-01-011710Lightweight mobile network for real-time violence recognitionYoushan ZhangYong LiShaozhe GuoMost existing violence recognition methods have complex network structures and high cost of computation and cannot meet the requirements of large-scale deployment. The purpose of this paper is to reduce the complexity of the model to realize the application of violence recognition on mobile intelligent terminals. To solve this problem, we propose MobileNet-TSM, a lightweight network, which uses MobileNet-V2 as main structure. By incorporating temporal shift modules (TSM), which can exchange information between frames, the capability of extracting dynamic characteristics between consecutive frames is strengthened. Extensive experiments are conducted to prove the validity of this method. Our proposed model has only 8.49MB parameters and 175.86MB estimated total size. Compared with the existing methods, this method greatly reduced the model size, at the cost of an accuracy gap of about 3%. The proposed model has achieved accuracy of 97.959%, 97.5% and 87.75% on three public datasets (Crowd Violence, Hockey Fights, and RWF-2000), respectively. Based on this, we also build a real-time violence recognition application on the Android terminal. The source code and trained models are available on https://github.com/1840210289/MobileNet-TSM.git.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9621415/?tool=EBI |
| spellingShingle | Youshan Zhang Yong Li Shaozhe Guo Lightweight mobile network for real-time violence recognition PLoS ONE |
| title | Lightweight mobile network for real-time violence recognition |
| title_full | Lightweight mobile network for real-time violence recognition |
| title_fullStr | Lightweight mobile network for real-time violence recognition |
| title_full_unstemmed | Lightweight mobile network for real-time violence recognition |
| title_short | Lightweight mobile network for real-time violence recognition |
| title_sort | lightweight mobile network for real time violence recognition |
| url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9621415/?tool=EBI |
| work_keys_str_mv | AT youshanzhang lightweightmobilenetworkforrealtimeviolencerecognition AT yongli lightweightmobilenetworkforrealtimeviolencerecognition AT shaozheguo lightweightmobilenetworkforrealtimeviolencerecognition |