Human-AI Teaming During an Ongoing Disaster: How Scripts Around Training and Feedback Reveal this is a Form of Human-Machine Communication

Humans play an integral role in identifying important information from social media during disasters. While human annotation of social media data to train machine learning models is often viewed as human-computer interaction, this study interrogates the ontological boundary between such interaction...

Full description

Bibliographic Details
Main Authors: Keri K. Stephens, Anastazja G. Harris, Amanda L. Hughes, Carolyn E. Montagnolo, Karim Nader, S. Ashley Stevensons, Tara Tasuji, Yifan Xu, Hemant Purohit, Christopher W. Zobel
Format: Article
Language:English
Published: Communication and Social Robotics Labs 2023-07-01
Series:Human-Machine Communication Journal
Subjects:
Description
Summary:Humans play an integral role in identifying important information from social media during disasters. While human annotation of social media data to train machine learning models is often viewed as human-computer interaction, this study interrogates the ontological boundary between such interaction and human-machine communication. We conducted multiple interviews with participants who both labeled data to train machine learning models and corrected machine-inferred data labels. Findings reveal three themes: scripts invoked to manage decision-making, contextual scripts, and scripts around perceptions of machines. Humans use scripts around training the machine—a form of behavioral anthropomorphism—to develop social relationships with them. Correcting machine-inferred data labels changes these scripts and evokes self-doubt around who is right, which substantiates the argument that this is a form of human-machine communication.
ISSN:2638-602X
2638-6038