Nutrient and Food Group Prediction as Orchestrated by an Automated Image Recognition System in a Smartphone App (CALO mama): Validation Study
BackgroundA smartphone image recognition app is expected to be a novel tool for measuring nutrients and food intake, but its performance has not been well evaluated. ObjectiveWe assessed the accuracy of the performance of an image recognition app called CALO mama...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2022-01-01
|
| Series: | JMIR Formative Research |
| Online Access: | https://formative.jmir.org/2022/1/e31875 |
| _version_ | 1797735402067460096 |
|---|---|
| author | Yuki Sasaki Koryu Sato Satomi Kobayashi Keiko Asakura |
| author_facet | Yuki Sasaki Koryu Sato Satomi Kobayashi Keiko Asakura |
| author_sort | Yuki Sasaki |
| collection | DOAJ |
| description |
BackgroundA smartphone image recognition app is expected to be a novel tool for measuring nutrients and food intake, but its performance has not been well evaluated.
ObjectiveWe assessed the accuracy of the performance of an image recognition app called CALO mama in terms of the nutrient and food group contents automatically estimated by the app.
MethodsWe prepared 120 meal samples for which the nutrients and food groups were calculated. Next, we predicted the nutrients and food groups included in the meals from their photographs by using (1) automated image recognition only and (2) manual modification after automatic identification.
ResultsPredictions generated using only image recognition were similar to the actual data on the weight of meals and were accurate for 11 out of 30 nutrients and 4 out of 15 food groups. The app underestimated energy, 19 nutrients, and 9 food groups, while it overestimated dairy products and confectioneries. After manual modification, the predictions were similar for energy, accurately capturing the nutrients for 29 out of 30 of meals and the food groups for 10 out of 15 meals. The app underestimated pulses, fruits, and meats, while it overestimated weight, vitamin C, vegetables, and confectioneries.
ConclusionsThe results of this study suggest that manual modification after prediction using image recognition improves the performance of the app in assessing the nutrients and food groups of meals. Our findings suggest that image recognition has the potential to achieve a description of the dietary intakes of populations by using “precision nutrition” (a comprehensive and dynamic approach to developing tailored nutritional recommendations) for individuals. |
| first_indexed | 2024-03-12T12:58:32Z |
| format | Article |
| id | doaj.art-7cc409cadbf945a685a742b6d2f28b0a |
| institution | Directory Open Access Journal |
| issn | 2561-326X |
| language | English |
| last_indexed | 2024-03-12T12:58:32Z |
| publishDate | 2022-01-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Formative Research |
| spelling | doaj.art-7cc409cadbf945a685a742b6d2f28b0a2023-08-28T20:19:40ZengJMIR PublicationsJMIR Formative Research2561-326X2022-01-0161e3187510.2196/31875Nutrient and Food Group Prediction as Orchestrated by an Automated Image Recognition System in a Smartphone App (CALO mama): Validation StudyYuki Sasakihttps://orcid.org/0000-0001-9119-643XKoryu Satohttps://orcid.org/0000-0002-8418-8535Satomi Kobayashihttps://orcid.org/0000-0001-8798-8549Keiko Asakurahttps://orcid.org/0000-0002-2323-1640 BackgroundA smartphone image recognition app is expected to be a novel tool for measuring nutrients and food intake, but its performance has not been well evaluated. ObjectiveWe assessed the accuracy of the performance of an image recognition app called CALO mama in terms of the nutrient and food group contents automatically estimated by the app. MethodsWe prepared 120 meal samples for which the nutrients and food groups were calculated. Next, we predicted the nutrients and food groups included in the meals from their photographs by using (1) automated image recognition only and (2) manual modification after automatic identification. ResultsPredictions generated using only image recognition were similar to the actual data on the weight of meals and were accurate for 11 out of 30 nutrients and 4 out of 15 food groups. The app underestimated energy, 19 nutrients, and 9 food groups, while it overestimated dairy products and confectioneries. After manual modification, the predictions were similar for energy, accurately capturing the nutrients for 29 out of 30 of meals and the food groups for 10 out of 15 meals. The app underestimated pulses, fruits, and meats, while it overestimated weight, vitamin C, vegetables, and confectioneries. ConclusionsThe results of this study suggest that manual modification after prediction using image recognition improves the performance of the app in assessing the nutrients and food groups of meals. Our findings suggest that image recognition has the potential to achieve a description of the dietary intakes of populations by using “precision nutrition” (a comprehensive and dynamic approach to developing tailored nutritional recommendations) for individuals.https://formative.jmir.org/2022/1/e31875 |
| spellingShingle | Yuki Sasaki Koryu Sato Satomi Kobayashi Keiko Asakura Nutrient and Food Group Prediction as Orchestrated by an Automated Image Recognition System in a Smartphone App (CALO mama): Validation Study JMIR Formative Research |
| title | Nutrient and Food Group Prediction as Orchestrated by an Automated Image Recognition System in a Smartphone App (CALO mama): Validation Study |
| title_full | Nutrient and Food Group Prediction as Orchestrated by an Automated Image Recognition System in a Smartphone App (CALO mama): Validation Study |
| title_fullStr | Nutrient and Food Group Prediction as Orchestrated by an Automated Image Recognition System in a Smartphone App (CALO mama): Validation Study |
| title_full_unstemmed | Nutrient and Food Group Prediction as Orchestrated by an Automated Image Recognition System in a Smartphone App (CALO mama): Validation Study |
| title_short | Nutrient and Food Group Prediction as Orchestrated by an Automated Image Recognition System in a Smartphone App (CALO mama): Validation Study |
| title_sort | nutrient and food group prediction as orchestrated by an automated image recognition system in a smartphone app calo mama validation study |
| url | https://formative.jmir.org/2022/1/e31875 |
| work_keys_str_mv | AT yukisasaki nutrientandfoodgrouppredictionasorchestratedbyanautomatedimagerecognitionsysteminasmartphoneappcalomamavalidationstudy AT koryusato nutrientandfoodgrouppredictionasorchestratedbyanautomatedimagerecognitionsysteminasmartphoneappcalomamavalidationstudy AT satomikobayashi nutrientandfoodgrouppredictionasorchestratedbyanautomatedimagerecognitionsysteminasmartphoneappcalomamavalidationstudy AT keikoasakura nutrientandfoodgrouppredictionasorchestratedbyanautomatedimagerecognitionsysteminasmartphoneappcalomamavalidationstudy |