Recognition of food images based on transfer learning and ensemble learning.
The recognition of food images is of great significance for nutrition monitoring, food retrieval and food recommendation. However, the accuracy of recognition had not been high enough due to the complex background of food images and the characteristics of small inter-class differences and large intr...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2024-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0296789&type=printable |
| _version_ | 1797349365528920064 |
|---|---|
| author | Le Bu Caiping Hu Xiuliang Zhang |
| author_facet | Le Bu Caiping Hu Xiuliang Zhang |
| author_sort | Le Bu |
| collection | DOAJ |
| description | The recognition of food images is of great significance for nutrition monitoring, food retrieval and food recommendation. However, the accuracy of recognition had not been high enough due to the complex background of food images and the characteristics of small inter-class differences and large intra-class differences. To solve these problems, this paper proposed a food image recognition method based on transfer learning and ensemble learning. Firstly, generic image features were extracted by using the convolutional neural network models (VGG19, ResNet50, MobileNet V2, AlexNet) pre-trained on the ImageNet dataset. Secondly, the 4 pre-trained models were transferred to the food image dataset for model fine-tuning. Finally, different basic learner combination strategies were adopted to establish the ensemble model and classify feature information. In this paper, several kinds of experiments were performed to compare the results of food image recognition between single models and ensemble models on food-11 dataset. The experimental results demonstrated that the accuracy of the ensemble model was the highest, reaching 96.88%, which was superior to any base learner. Therefore, the convolutional neural network model based on transfer learning and ensemble learning has strong learning ability and generalization ability, and it is feasible and practical to apply the method to food image recognition. |
| first_indexed | 2024-03-08T12:29:24Z |
| format | Article |
| id | doaj.art-91442fe285b74034a64d8539791ffc15 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-03-08T12:29:24Z |
| publishDate | 2024-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-91442fe285b74034a64d8539791ffc152024-01-22T05:31:23ZengPublic Library of Science (PLoS)PLoS ONE1932-62032024-01-01191e029678910.1371/journal.pone.0296789Recognition of food images based on transfer learning and ensemble learning.Le BuCaiping HuXiuliang ZhangThe recognition of food images is of great significance for nutrition monitoring, food retrieval and food recommendation. However, the accuracy of recognition had not been high enough due to the complex background of food images and the characteristics of small inter-class differences and large intra-class differences. To solve these problems, this paper proposed a food image recognition method based on transfer learning and ensemble learning. Firstly, generic image features were extracted by using the convolutional neural network models (VGG19, ResNet50, MobileNet V2, AlexNet) pre-trained on the ImageNet dataset. Secondly, the 4 pre-trained models were transferred to the food image dataset for model fine-tuning. Finally, different basic learner combination strategies were adopted to establish the ensemble model and classify feature information. In this paper, several kinds of experiments were performed to compare the results of food image recognition between single models and ensemble models on food-11 dataset. The experimental results demonstrated that the accuracy of the ensemble model was the highest, reaching 96.88%, which was superior to any base learner. Therefore, the convolutional neural network model based on transfer learning and ensemble learning has strong learning ability and generalization ability, and it is feasible and practical to apply the method to food image recognition.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0296789&type=printable |
| spellingShingle | Le Bu Caiping Hu Xiuliang Zhang Recognition of food images based on transfer learning and ensemble learning. PLoS ONE |
| title | Recognition of food images based on transfer learning and ensemble learning. |
| title_full | Recognition of food images based on transfer learning and ensemble learning. |
| title_fullStr | Recognition of food images based on transfer learning and ensemble learning. |
| title_full_unstemmed | Recognition of food images based on transfer learning and ensemble learning. |
| title_short | Recognition of food images based on transfer learning and ensemble learning. |
| title_sort | recognition of food images based on transfer learning and ensemble learning |
| url | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0296789&type=printable |
| work_keys_str_mv | AT lebu recognitionoffoodimagesbasedontransferlearningandensemblelearning AT caipinghu recognitionoffoodimagesbasedontransferlearningandensemblelearning AT xiuliangzhang recognitionoffoodimagesbasedontransferlearningandensemblelearning |