Learning optimal discourse strategies in a spoken dialogue system
Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1998.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2009
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/47703 |
| _version_ | 1811098203131478016 |
|---|---|
| author | Fromer, Jeanne C., 1975- |
| author2 | Robert C. Berwick. |
| author_facet | Robert C. Berwick. Fromer, Jeanne C., 1975- |
| author_sort | Fromer, Jeanne C., 1975- |
| collection | MIT |
| description | Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1998. |
| first_indexed | 2024-09-23T17:11:31Z |
| format | Thesis |
| id | mit-1721.1/47703 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T17:11:31Z |
| publishDate | 2009 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/477032020-07-14T22:07:08Z Learning optimal discourse strategies in a spoken dialogue system Fromer, Jeanne C., 1975- Robert C. Berwick. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Electrical Engineering and Computer Science Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1998. Includes bibliographical references (p. 123-129). Participants in a conversation can often realize their conversational goals in multiple ways by employing different discourse strategies. For example, one can usually present requested information in various ways; different presentation methods are preferred and most effective in varying contexts. One can also manage conversations, or assume initiative, to varying degrees by directing questions, issuing commands, restricting potential responses, and controlling discussion topics in different ways. Agents that converse with users in natural language and possess different discourse strategies need to choose and realize the optimal strategy from competing strategies. Previous work in natural language generation has selected discourse strategies by using heuristics based on discourse focus, medium, style, and the content of previous utterances. Recent work suggests that an agent can learn which strategies are optimal. This thesis investigates the issues involved with learning optimal discourse strategies on the basis of experience gained through conversations between human users and natural language agents. A spoken dialogue agent, ELVIS, is implemented as a testbed for learning optimal discourse strategies. ELVIS provides telephone-based voice access to a caller's email. Within ELVIS, various discourse strategies for the distribution of initiative, reading messages, and summarizing messages are implemented. Actual users interact with discourse strategy-based variations of ELVIS. Their conversations are used to derive a dialogue performance function for ELVIS using the PARADISE dialogue evaluation framework. This performance function is then used with reinforcement learning techniques, such as adaptive dynamic programming, Q-learning, temporal difference learning, and temporal difference Q-learning, to determine the optimal discourse strategies for ELVIS to use in different contexts. This thesis reports and compares learning results and describes how the particular reinforcement algorithm, local reward functions, and the system state space representation affect the efficiency and the outcome of the learning results. This thesis concludes by suggesting how it may be possible to automate online learning in spoken dialogue systems by extending the presented evaluation and learning techniques. by Jeanne C. Fromer. S.M. 2009-10-01T15:33:34Z 2009-10-01T15:33:34Z 1998 1998 Thesis http://hdl.handle.net/1721.1/47703 42306186 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 129 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science Fromer, Jeanne C., 1975- Learning optimal discourse strategies in a spoken dialogue system |
| title | Learning optimal discourse strategies in a spoken dialogue system |
| title_full | Learning optimal discourse strategies in a spoken dialogue system |
| title_fullStr | Learning optimal discourse strategies in a spoken dialogue system |
| title_full_unstemmed | Learning optimal discourse strategies in a spoken dialogue system |
| title_short | Learning optimal discourse strategies in a spoken dialogue system |
| title_sort | learning optimal discourse strategies in a spoken dialogue system |
| topic | Electrical Engineering and Computer Science |
| url | http://hdl.handle.net/1721.1/47703 |
| work_keys_str_mv | AT fromerjeannec1975 learningoptimaldiscoursestrategiesinaspokendialoguesystem |