Feature Extraction Based on the Non-Negative Matrix Factorization of Convolutional Neural Networks for Monitoring Domestic Activity With Acoustic Signals
In this paper, a feature extraction method is proposed based on the non-negative matrix factorization (NMF) for classifiers for monitoring domestic activities with acoustic signals. Most of the classifiers of the acoustic signals use data-independent spectral features (e.g., log-Mel spectrum and Mel...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9133398/ |
| _version_ | 1818733121775861760 |
|---|---|
| author | Seokjin Lee Hee-Suk Pang |
| author_facet | Seokjin Lee Hee-Suk Pang |
| author_sort | Seokjin Lee |
| collection | DOAJ |
| description | In this paper, a feature extraction method is proposed based on the non-negative matrix factorization (NMF) for classifiers for monitoring domestic activities with acoustic signals. Most of the classifiers of the acoustic signals use data-independent spectral features (e.g., log-Mel spectrum and Mel-frequency cepstral coefficients). Recently, some novel feature extraction methods have been researched, including convolution-NMF-based features combined with K-means clustering. This study proposes an enhanced NMF-based feature extraction method that is inspired by the NMF-based noise reduction algorithm. The proposed method independently estimates the frequency basis matrix for each class, and then cascades the basis matrices to form the entire frequency bases, where the acoustic signal is transformed to the proposed feature by estimating the temporal basis matrix with the trained frequency bases. In addition, this study proposes a data augmentation method for the proposed feature that is inspired by the “mix and shuffle” method for audio waveforms. In order to evaluate the proposed system, which consists of the proposed NMF-based feature and the convolutional-neural-network-based classifier, some evaluations were performed using the Detection and Classification of Acoustic Scenes and Events (DCASE) 2018 Task 5 - Monitoring of Domestic Activities Based on Multi-channel Acoustics - Database. The results showed that the proposed system has comparable performance to that of state-of-the-art algorithms and that it has enhanced the F1-score performance of 6%-12% in comparison with the conventional NMF-based feature extraction method that is based on convolutional NMF and K-means clustering. |
| first_indexed | 2024-12-17T23:44:26Z |
| format | Article |
| id | doaj.art-67b6d0d5c2a247ebbfa8d5bfd2bfee36 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-17T23:44:26Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-67b6d0d5c2a247ebbfa8d5bfd2bfee362022-12-21T21:28:21ZengIEEEIEEE Access2169-35362020-01-01812238412239510.1109/ACCESS.2020.30071999133398Feature Extraction Based on the Non-Negative Matrix Factorization of Convolutional Neural Networks for Monitoring Domestic Activity With Acoustic SignalsSeokjin Lee0https://orcid.org/0000-0001-8220-192XHee-Suk Pang1School of Electronics Engineering, Kyungpook National University, Daegu, South KoreaDepartment of Electrical Engineering, Sejong University, Seoul, South KoreaIn this paper, a feature extraction method is proposed based on the non-negative matrix factorization (NMF) for classifiers for monitoring domestic activities with acoustic signals. Most of the classifiers of the acoustic signals use data-independent spectral features (e.g., log-Mel spectrum and Mel-frequency cepstral coefficients). Recently, some novel feature extraction methods have been researched, including convolution-NMF-based features combined with K-means clustering. This study proposes an enhanced NMF-based feature extraction method that is inspired by the NMF-based noise reduction algorithm. The proposed method independently estimates the frequency basis matrix for each class, and then cascades the basis matrices to form the entire frequency bases, where the acoustic signal is transformed to the proposed feature by estimating the temporal basis matrix with the trained frequency bases. In addition, this study proposes a data augmentation method for the proposed feature that is inspired by the “mix and shuffle” method for audio waveforms. In order to evaluate the proposed system, which consists of the proposed NMF-based feature and the convolutional-neural-network-based classifier, some evaluations were performed using the Detection and Classification of Acoustic Scenes and Events (DCASE) 2018 Task 5 - Monitoring of Domestic Activities Based on Multi-channel Acoustics - Database. The results showed that the proposed system has comparable performance to that of state-of-the-art algorithms and that it has enhanced the F1-score performance of 6%-12% in comparison with the conventional NMF-based feature extraction method that is based on convolutional NMF and K-means clustering.https://ieeexplore.ieee.org/document/9133398/Acoustic scene classificationconvolutional neural networksfeature extractionnon-negative matrix factorization |
| spellingShingle | Seokjin Lee Hee-Suk Pang Feature Extraction Based on the Non-Negative Matrix Factorization of Convolutional Neural Networks for Monitoring Domestic Activity With Acoustic Signals IEEE Access Acoustic scene classification convolutional neural networks feature extraction non-negative matrix factorization |
| title | Feature Extraction Based on the Non-Negative Matrix Factorization of Convolutional Neural Networks for Monitoring Domestic Activity With Acoustic Signals |
| title_full | Feature Extraction Based on the Non-Negative Matrix Factorization of Convolutional Neural Networks for Monitoring Domestic Activity With Acoustic Signals |
| title_fullStr | Feature Extraction Based on the Non-Negative Matrix Factorization of Convolutional Neural Networks for Monitoring Domestic Activity With Acoustic Signals |
| title_full_unstemmed | Feature Extraction Based on the Non-Negative Matrix Factorization of Convolutional Neural Networks for Monitoring Domestic Activity With Acoustic Signals |
| title_short | Feature Extraction Based on the Non-Negative Matrix Factorization of Convolutional Neural Networks for Monitoring Domestic Activity With Acoustic Signals |
| title_sort | feature extraction based on the non negative matrix factorization of convolutional neural networks for monitoring domestic activity with acoustic signals |
| topic | Acoustic scene classification convolutional neural networks feature extraction non-negative matrix factorization |
| url | https://ieeexplore.ieee.org/document/9133398/ |
| work_keys_str_mv | AT seokjinlee featureextractionbasedonthenonnegativematrixfactorizationofconvolutionalneuralnetworksformonitoringdomesticactivitywithacousticsignals AT heesukpang featureextractionbasedonthenonnegativematrixfactorizationofconvolutionalneuralnetworksformonitoringdomesticactivitywithacousticsignals |