MACH: My Automated Conversation coacH

MACH--My Automated Conversation coacH--is a novel system that provides ubiquitous access to social skills training. The system includes a virtual agent that reads facial expressions, speech, and prosody and responds with verbal and nonverbal behaviors in real time. This paper presents an application...

Full description

Bibliographic Details
Main Authors: Courgeon, Matthieu, Martin, Jean-Claude, Mutlu, Bilge, Picard, Rosalind W., Hoque, Mohammed Ehasanul
Other Authors: Massachusetts Institute of Technology. Media Laboratory
Format: Article
Language:en_US
Published: Association for Computing Machinery (ACM) 2014
Online Access:http://hdl.handle.net/1721.1/92442
https://orcid.org/0000-0002-5661-0022
_version_ 1826203591031914496
author Courgeon, Matthieu
Martin, Jean-Claude
Mutlu, Bilge
Picard, Rosalind W.
Hoque, Mohammed Ehasanul
author2 Massachusetts Institute of Technology. Media Laboratory
author_facet Massachusetts Institute of Technology. Media Laboratory
Courgeon, Matthieu
Martin, Jean-Claude
Mutlu, Bilge
Picard, Rosalind W.
Hoque, Mohammed Ehasanul
author_sort Courgeon, Matthieu
collection MIT
description MACH--My Automated Conversation coacH--is a novel system that provides ubiquitous access to social skills training. The system includes a virtual agent that reads facial expressions, speech, and prosody and responds with verbal and nonverbal behaviors in real time. This paper presents an application of MACH in the context of training for job interviews. During the training, MACH asks interview questions, automatically mimics certain behavior issued by the user, and exhibit appropriate nonverbal behaviors. Following the interaction, MACH provides visual feedback on the user's performance. The development of this application draws on data from 28 interview sessions, involving employment-seeking students and career counselors. The effectiveness of MACH was assessed through a weeklong trial with 90 MIT undergraduates. Students who interacted with MACH were rated by human experts to have improved in overall interview performance, while the ratings of students in control groups did not improve. Post-experiment interviews indicate that participants found the interview experience informative about their behaviors and expressed interest in using MACH in the future.
first_indexed 2024-09-23T12:39:42Z
format Article
id mit-1721.1/92442
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T12:39:42Z
publishDate 2014
publisher Association for Computing Machinery (ACM)
record_format dspace
spelling mit-1721.1/924422022-10-01T10:20:09Z MACH: My Automated Conversation coacH Courgeon, Matthieu Martin, Jean-Claude Mutlu, Bilge Picard, Rosalind W. Hoque, Mohammed Ehasanul Massachusetts Institute of Technology. Media Laboratory Program in Media Arts and Sciences (Massachusetts Institute of Technology) Hoque, Mohammed Ehasanul Picard, Rosalind W. MACH--My Automated Conversation coacH--is a novel system that provides ubiquitous access to social skills training. The system includes a virtual agent that reads facial expressions, speech, and prosody and responds with verbal and nonverbal behaviors in real time. This paper presents an application of MACH in the context of training for job interviews. During the training, MACH asks interview questions, automatically mimics certain behavior issued by the user, and exhibit appropriate nonverbal behaviors. Following the interaction, MACH provides visual feedback on the user's performance. The development of this application draws on data from 28 interview sessions, involving employment-seeking students and career counselors. The effectiveness of MACH was assessed through a weeklong trial with 90 MIT undergraduates. Students who interacted with MACH were rated by human experts to have improved in overall interview performance, while the ratings of students in control groups did not improve. Post-experiment interviews indicate that participants found the interview experience informative about their behaviors and expressed interest in using MACH in the future. Samsung (Firm) MIT Media Lab Consortium 2014-12-22T18:43:58Z 2014-12-22T18:43:58Z 2013-09 Article http://purl.org/eprint/type/ConferencePaper 9781450317702 http://hdl.handle.net/1721.1/92442 Mohammed (Ehsan) Hoque, Matthieu Courgeon, Jean-Claude Martin, Bilge Mutlu, and Rosalind W. Picard. 2013. MACH: my automated conversation coach. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing (UbiComp '13). ACM, New York, NY, USA, 697-706. https://orcid.org/0000-0002-5661-0022 en_US http://dx.doi.org/10.1145/2493432.2493502 Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing (UbiComp '13) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Association for Computing Machinery (ACM) MIT web domain
spellingShingle Courgeon, Matthieu
Martin, Jean-Claude
Mutlu, Bilge
Picard, Rosalind W.
Hoque, Mohammed Ehasanul
MACH: My Automated Conversation coacH
title MACH: My Automated Conversation coacH
title_full MACH: My Automated Conversation coacH
title_fullStr MACH: My Automated Conversation coacH
title_full_unstemmed MACH: My Automated Conversation coacH
title_short MACH: My Automated Conversation coacH
title_sort mach my automated conversation coach
url http://hdl.handle.net/1721.1/92442
https://orcid.org/0000-0002-5661-0022
work_keys_str_mv AT courgeonmatthieu machmyautomatedconversationcoach
AT martinjeanclaude machmyautomatedconversationcoach
AT mutlubilge machmyautomatedconversationcoach
AT picardrosalindw machmyautomatedconversationcoach
AT hoquemohammedehasanul machmyautomatedconversationcoach