A new iterative initialization of EM algorithm for Gaussian mixture models
<h4>Background</h4> The expectation maximization (EM) algorithm is a common tool for estimating the parameters of Gaussian mixture models (GMM). However, it is highly sensitive to initial value and easily gets trapped in a local optimum. <h4>Method</h4> To address these probl...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2023-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10101421/?tool=EBI |
| _version_ | 1827966572040290304 |
|---|---|
| author | Jie You Zhaoxuan Li Junli Du |
| author_facet | Jie You Zhaoxuan Li Junli Du |
| author_sort | Jie You |
| collection | DOAJ |
| description | <h4>Background</h4> The expectation maximization (EM) algorithm is a common tool for estimating the parameters of Gaussian mixture models (GMM). However, it is highly sensitive to initial value and easily gets trapped in a local optimum. <h4>Method</h4> To address these problems, a new iterative method of EM initialization (MRIPEM) is proposed in this paper. It incorporates the ideas of multiple restarts, iterations and clustering. In particular, the mean vector and covariance matrix of sample are calculated as the initial values of the iteration. Then, the optimal feature vector is selected from the candidate feature vectors by the maximum Mahalanobis distance as a new partition vector for clustering. The parameter values are renewed continuously according to the clustering results. <h4>Results</h4> To verify the applicability of the MRIPEM, we compared it with other two popular initialization methods on simulated and real datasets, respectively. The comparison results of the three stochastic algorithms indicate that MRIPEM algorithm is comparable in relatively high dimensions and high overlaps and significantly better in low dimensions and low overlaps. |
| first_indexed | 2024-04-09T17:52:03Z |
| format | Article |
| id | doaj.art-f9030a3e7f5b4ec3ad0d730ce56e4079 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-04-09T17:52:03Z |
| publishDate | 2023-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-f9030a3e7f5b4ec3ad0d730ce56e40792023-04-16T05:31:40ZengPublic Library of Science (PLoS)PLoS ONE1932-62032023-01-01184A new iterative initialization of EM algorithm for Gaussian mixture modelsJie YouZhaoxuan LiJunli Du<h4>Background</h4> The expectation maximization (EM) algorithm is a common tool for estimating the parameters of Gaussian mixture models (GMM). However, it is highly sensitive to initial value and easily gets trapped in a local optimum. <h4>Method</h4> To address these problems, a new iterative method of EM initialization (MRIPEM) is proposed in this paper. It incorporates the ideas of multiple restarts, iterations and clustering. In particular, the mean vector and covariance matrix of sample are calculated as the initial values of the iteration. Then, the optimal feature vector is selected from the candidate feature vectors by the maximum Mahalanobis distance as a new partition vector for clustering. The parameter values are renewed continuously according to the clustering results. <h4>Results</h4> To verify the applicability of the MRIPEM, we compared it with other two popular initialization methods on simulated and real datasets, respectively. The comparison results of the three stochastic algorithms indicate that MRIPEM algorithm is comparable in relatively high dimensions and high overlaps and significantly better in low dimensions and low overlaps.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10101421/?tool=EBI |
| spellingShingle | Jie You Zhaoxuan Li Junli Du A new iterative initialization of EM algorithm for Gaussian mixture models PLoS ONE |
| title | A new iterative initialization of EM algorithm for Gaussian mixture models |
| title_full | A new iterative initialization of EM algorithm for Gaussian mixture models |
| title_fullStr | A new iterative initialization of EM algorithm for Gaussian mixture models |
| title_full_unstemmed | A new iterative initialization of EM algorithm for Gaussian mixture models |
| title_short | A new iterative initialization of EM algorithm for Gaussian mixture models |
| title_sort | new iterative initialization of em algorithm for gaussian mixture models |
| url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10101421/?tool=EBI |
| work_keys_str_mv | AT jieyou anewiterativeinitializationofemalgorithmforgaussianmixturemodels AT zhaoxuanli anewiterativeinitializationofemalgorithmforgaussianmixturemodels AT junlidu anewiterativeinitializationofemalgorithmforgaussianmixturemodels AT jieyou newiterativeinitializationofemalgorithmforgaussianmixturemodels AT zhaoxuanli newiterativeinitializationofemalgorithmforgaussianmixturemodels AT junlidu newiterativeinitializationofemalgorithmforgaussianmixturemodels |