Spoken language understanding in a nutrition dialogue system

Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2015.

Bibliographic Details
Main Author: Korpusik, Mandy B
Other Authors: James R. Glass.
Format: Thesis
Language:eng
Published: Massachusetts Institute of Technology 2015
Subjects:
Online Access:http://hdl.handle.net/1721.1/99860
_version_ 1826212407053123584
author Korpusik, Mandy B
author2 James R. Glass.
author_facet James R. Glass.
Korpusik, Mandy B
author_sort Korpusik, Mandy B
collection MIT
description Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2015.
first_indexed 2024-09-23T15:21:12Z
format Thesis
id mit-1721.1/99860
institution Massachusetts Institute of Technology
language eng
last_indexed 2024-09-23T15:21:12Z
publishDate 2015
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/998602019-04-10T07:48:49Z Spoken language understanding in a nutrition dialogue system Korpusik, Mandy B James R. Glass. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2015. Cataloged from PDF version of thesis. Includes bibliographical references (pages 105-111). Existing approaches for the prevention and treatment of obesity are hampered by the lack of accurate, low-burden methods for self-assessment of food intake, especially for hard-to-reach, low-literate populations. For this reason, we propose a novel approach to diet tracking that utilizes speech understanding and dialogue technology in order to enable efficient self-assessment of energy and nutrient consumption. We are interested in studying whether speech can lower user workload compared to existing self-assessment methods, whether spoken language descriptions of meals can accurately quantify caloric and nutrient absorption, and whether dialogue can efficiently and effectively be used to ascertain and clarify food properties, perhaps in conjunction with other modalities. In this thesis, we explore the core innovation of our nutrition system: the language understanding component which relies on machine learning methods to automatically detect food concepts in a user's spoken meal description. In particular, we investigate the performance of conditional random field (CRF) models for semantic labeling and segmentation of spoken meal descriptions. On a corpus of 10,000 meal descriptions, we achieve an average F1 test score of 90.7 for semantic tagging and 86.3 for associating foods with properties. In a study of users interacting with an initial prototype of the system, semantic tagging achieved an accuracy of 83%, which was sufficiently high to satisfy users. by Mandy B. Korpusik. S.M. 2015-11-09T19:53:37Z 2015-11-09T19:53:37Z 2015 2015 Thesis http://hdl.handle.net/1721.1/99860 927721629 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 111 pages application/pdf Massachusetts Institute of Technology
spellingShingle Electrical Engineering and Computer Science.
Korpusik, Mandy B
Spoken language understanding in a nutrition dialogue system
title Spoken language understanding in a nutrition dialogue system
title_full Spoken language understanding in a nutrition dialogue system
title_fullStr Spoken language understanding in a nutrition dialogue system
title_full_unstemmed Spoken language understanding in a nutrition dialogue system
title_short Spoken language understanding in a nutrition dialogue system
title_sort spoken language understanding in a nutrition dialogue system
topic Electrical Engineering and Computer Science.
url http://hdl.handle.net/1721.1/99860
work_keys_str_mv AT korpusikmandyb spokenlanguageunderstandinginanutritiondialoguesystem