MACH: My Automated Conversation coacH
MACH--My Automated Conversation coacH--is a novel system that provides ubiquitous access to social skills training. The system includes a virtual agent that reads facial expressions, speech, and prosody and responds with verbal and nonverbal behaviors in real time. This paper presents an application...
Main Authors: | , , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | en_US |
Published: |
Association for Computing Machinery (ACM)
2014
|
Online Access: | http://hdl.handle.net/1721.1/92442 https://orcid.org/0000-0002-5661-0022 |
_version_ | 1826203591031914496 |
---|---|
author | Courgeon, Matthieu Martin, Jean-Claude Mutlu, Bilge Picard, Rosalind W. Hoque, Mohammed Ehasanul |
author2 | Massachusetts Institute of Technology. Media Laboratory |
author_facet | Massachusetts Institute of Technology. Media Laboratory Courgeon, Matthieu Martin, Jean-Claude Mutlu, Bilge Picard, Rosalind W. Hoque, Mohammed Ehasanul |
author_sort | Courgeon, Matthieu |
collection | MIT |
description | MACH--My Automated Conversation coacH--is a novel system that provides ubiquitous access to social skills training. The system includes a virtual agent that reads facial expressions, speech, and prosody and responds with verbal and nonverbal behaviors in real time. This paper presents an application of MACH in the context of training for job interviews. During the training, MACH asks interview questions, automatically mimics certain behavior issued by the user, and exhibit appropriate nonverbal behaviors. Following the interaction, MACH provides visual feedback on the user's performance. The development of this application draws on data from 28 interview sessions, involving employment-seeking students and career counselors. The effectiveness of MACH was assessed through a weeklong trial with 90 MIT undergraduates. Students who interacted with MACH were rated by human experts to have improved in overall interview performance, while the ratings of students in control groups did not improve. Post-experiment interviews indicate that participants found the interview experience informative about their behaviors and expressed interest in using MACH in the future. |
first_indexed | 2024-09-23T12:39:42Z |
format | Article |
id | mit-1721.1/92442 |
institution | Massachusetts Institute of Technology |
language | en_US |
last_indexed | 2024-09-23T12:39:42Z |
publishDate | 2014 |
publisher | Association for Computing Machinery (ACM) |
record_format | dspace |
spelling | mit-1721.1/924422022-10-01T10:20:09Z MACH: My Automated Conversation coacH Courgeon, Matthieu Martin, Jean-Claude Mutlu, Bilge Picard, Rosalind W. Hoque, Mohammed Ehasanul Massachusetts Institute of Technology. Media Laboratory Program in Media Arts and Sciences (Massachusetts Institute of Technology) Hoque, Mohammed Ehasanul Picard, Rosalind W. MACH--My Automated Conversation coacH--is a novel system that provides ubiquitous access to social skills training. The system includes a virtual agent that reads facial expressions, speech, and prosody and responds with verbal and nonverbal behaviors in real time. This paper presents an application of MACH in the context of training for job interviews. During the training, MACH asks interview questions, automatically mimics certain behavior issued by the user, and exhibit appropriate nonverbal behaviors. Following the interaction, MACH provides visual feedback on the user's performance. The development of this application draws on data from 28 interview sessions, involving employment-seeking students and career counselors. The effectiveness of MACH was assessed through a weeklong trial with 90 MIT undergraduates. Students who interacted with MACH were rated by human experts to have improved in overall interview performance, while the ratings of students in control groups did not improve. Post-experiment interviews indicate that participants found the interview experience informative about their behaviors and expressed interest in using MACH in the future. Samsung (Firm) MIT Media Lab Consortium 2014-12-22T18:43:58Z 2014-12-22T18:43:58Z 2013-09 Article http://purl.org/eprint/type/ConferencePaper 9781450317702 http://hdl.handle.net/1721.1/92442 Mohammed (Ehsan) Hoque, Matthieu Courgeon, Jean-Claude Martin, Bilge Mutlu, and Rosalind W. Picard. 2013. MACH: my automated conversation coach. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing (UbiComp '13). ACM, New York, NY, USA, 697-706. https://orcid.org/0000-0002-5661-0022 en_US http://dx.doi.org/10.1145/2493432.2493502 Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing (UbiComp '13) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Association for Computing Machinery (ACM) MIT web domain |
spellingShingle | Courgeon, Matthieu Martin, Jean-Claude Mutlu, Bilge Picard, Rosalind W. Hoque, Mohammed Ehasanul MACH: My Automated Conversation coacH |
title | MACH: My Automated Conversation coacH |
title_full | MACH: My Automated Conversation coacH |
title_fullStr | MACH: My Automated Conversation coacH |
title_full_unstemmed | MACH: My Automated Conversation coacH |
title_short | MACH: My Automated Conversation coacH |
title_sort | mach my automated conversation coach |
url | http://hdl.handle.net/1721.1/92442 https://orcid.org/0000-0002-5661-0022 |
work_keys_str_mv | AT courgeonmatthieu machmyautomatedconversationcoach AT martinjeanclaude machmyautomatedconversationcoach AT mutlubilge machmyautomatedconversationcoach AT picardrosalindw machmyautomatedconversationcoach AT hoquemohammedehasanul machmyautomatedconversationcoach |