Understanding evaluations of advice from chatbots : an exploration of advice response theory
This study extends Advice Response Theory (ART) to chatbot advisors and compares them to human advisors. We also explore how advice outcomes are affected when the element of uncertainty regarding advisor identity is introduced. Participants (N=443) rated sample advice messages from a human, chatbot...
| Main Authors: | , , , |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2021
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/147234 |
| _version_ | 1826129283087597568 |
|---|---|
| author | Chan, Share Yearn Sebastian, Lydia Sng, Shermaine Zhang, Jia’En |
| author2 | Andrew Prahl |
| author_facet | Andrew Prahl Chan, Share Yearn Sebastian, Lydia Sng, Shermaine Zhang, Jia’En |
| author_sort | Chan, Share Yearn |
| collection | NTU |
| description | This study extends Advice Response Theory (ART) to chatbot advisors and compares them to human advisors. We also explore how advice outcomes are affected when the element of uncertainty regarding advisor identity is introduced. Participants (N=443) rated sample advice messages from a human, chatbot or an “unknown” advisor, whereby the advisor could be either human or chatbot. We found that chatbot advisors were perceived less positively than humans which resulted in weaker influences of message content and worse evaluations of advice outcomes. Perceptions of unknown advisors were comparable with humans. Our findings provide insight for the continued use of ART in studying chatbot advisors and highlights the significance that the advisor identity has on advice evaluations. |
| first_indexed | 2024-10-01T07:38:06Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/147234 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T07:38:06Z |
| publishDate | 2021 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1472342023-03-05T16:16:47Z Understanding evaluations of advice from chatbots : an exploration of advice response theory Chan, Share Yearn Sebastian, Lydia Sng, Shermaine Zhang, Jia’En Andrew Prahl Wee Kim Wee School of Communication and Information andrew.prahl@ntu.edu.sg Social sciences::Communication This study extends Advice Response Theory (ART) to chatbot advisors and compares them to human advisors. We also explore how advice outcomes are affected when the element of uncertainty regarding advisor identity is introduced. Participants (N=443) rated sample advice messages from a human, chatbot or an “unknown” advisor, whereby the advisor could be either human or chatbot. We found that chatbot advisors were perceived less positively than humans which resulted in weaker influences of message content and worse evaluations of advice outcomes. Perceptions of unknown advisors were comparable with humans. Our findings provide insight for the continued use of ART in studying chatbot advisors and highlights the significance that the advisor identity has on advice evaluations. Bachelor of Communication Studies 2021-03-31T07:52:03Z 2021-03-31T07:52:03Z 2021 Final Year Project (FYP) Chan, S. Y., Sebastian, L., Sng, S. & Zhang, J. (2021). Understanding evaluations of advice from chatbots : an exploration of advice response theory. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/147234 https://hdl.handle.net/10356/147234 en SCI2044 application/pdf application/msword Nanyang Technological University |
| spellingShingle | Social sciences::Communication Chan, Share Yearn Sebastian, Lydia Sng, Shermaine Zhang, Jia’En Understanding evaluations of advice from chatbots : an exploration of advice response theory |
| title | Understanding evaluations of advice from chatbots : an exploration of advice response theory |
| title_full | Understanding evaluations of advice from chatbots : an exploration of advice response theory |
| title_fullStr | Understanding evaluations of advice from chatbots : an exploration of advice response theory |
| title_full_unstemmed | Understanding evaluations of advice from chatbots : an exploration of advice response theory |
| title_short | Understanding evaluations of advice from chatbots : an exploration of advice response theory |
| title_sort | understanding evaluations of advice from chatbots an exploration of advice response theory |
| topic | Social sciences::Communication |
| url | https://hdl.handle.net/10356/147234 |
| work_keys_str_mv | AT chanshareyearn understandingevaluationsofadvicefromchatbotsanexplorationofadviceresponsetheory AT sebastianlydia understandingevaluationsofadvicefromchatbotsanexplorationofadviceresponsetheory AT sngshermaine understandingevaluationsofadvicefromchatbotsanexplorationofadviceresponsetheory AT zhangjiaen understandingevaluationsofadvicefromchatbotsanexplorationofadviceresponsetheory |