The Effect of Social Information on Reliance and Efficacy in AI-assisted Prediction
This work addresses an under-explored aspect of people's utilization of algorithmic decision support systems: How do people perceive and use these systems under social influence? Through a pre-registered randomized human-subject experiment, I study the effect of two forms of social information-...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2024
|
| Online Access: | https://hdl.handle.net/1721.1/157105 |
| _version_ | 1824458025194225664 |
|---|---|
| author | Alsobay, Mohammed |
| author2 | Almaatouq, Abdullah |
| author_facet | Almaatouq, Abdullah Alsobay, Mohammed |
| author_sort | Alsobay, Mohammed |
| collection | MIT |
| description | This work addresses an under-explored aspect of people's utilization of algorithmic decision support systems: How do people perceive and use these systems under social influence? Through a pre-registered randomized human-subject experiment, I study the effect of two forms of social information-direct conversations and summarized peer decisions----on users' reliance and effectiveness in leveraging algorithmic advice across a series of decision-making tasks, and how t he availability of local model explanations and performance feedback moderates this effect. I find t hat, on average, neither form of social information affects t rust directly, yet they both moderate t he extent to which feedback and model explanations influence trust in the algorithm. However, while social information can influence trust in the algorithm, I detect no effect on how effectively people utilize algorithmic advice. By describing this interplay between social information, algorithmic transparency, and user behavior, this work contributes to recent research on collective intelligence and sociotechnical approaches to human-AI interaction. |
| first_indexed | 2025-02-19T04:19:19Z |
| format | Thesis |
| id | mit-1721.1/157105 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2025-02-19T04:19:19Z |
| publishDate | 2024 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1571052024-10-03T03:44:54Z The Effect of Social Information on Reliance and Efficacy in AI-assisted Prediction Alsobay, Mohammed Almaatouq, Abdullah Sloan School of Management This work addresses an under-explored aspect of people's utilization of algorithmic decision support systems: How do people perceive and use these systems under social influence? Through a pre-registered randomized human-subject experiment, I study the effect of two forms of social information-direct conversations and summarized peer decisions----on users' reliance and effectiveness in leveraging algorithmic advice across a series of decision-making tasks, and how t he availability of local model explanations and performance feedback moderates this effect. I find t hat, on average, neither form of social information affects t rust directly, yet they both moderate t he extent to which feedback and model explanations influence trust in the algorithm. However, while social information can influence trust in the algorithm, I detect no effect on how effectively people utilize algorithmic advice. By describing this interplay between social information, algorithmic transparency, and user behavior, this work contributes to recent research on collective intelligence and sociotechnical approaches to human-AI interaction. S.M. 2024-10-02T17:30:49Z 2024-10-02T17:30:49Z 2024-09 2024-08-22T19:43:16.138Z Thesis https://hdl.handle.net/1721.1/157105 In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Alsobay, Mohammed The Effect of Social Information on Reliance and Efficacy in AI-assisted Prediction |
| title | The Effect of Social Information on Reliance and Efficacy
in AI-assisted Prediction |
| title_full | The Effect of Social Information on Reliance and Efficacy
in AI-assisted Prediction |
| title_fullStr | The Effect of Social Information on Reliance and Efficacy
in AI-assisted Prediction |
| title_full_unstemmed | The Effect of Social Information on Reliance and Efficacy
in AI-assisted Prediction |
| title_short | The Effect of Social Information on Reliance and Efficacy
in AI-assisted Prediction |
| title_sort | effect of social information on reliance and efficacy in ai assisted prediction |
| url | https://hdl.handle.net/1721.1/157105 |
| work_keys_str_mv | AT alsobaymohammed theeffectofsocialinformationonrelianceandefficacyinaiassistedprediction AT alsobaymohammed effectofsocialinformationonrelianceandefficacyinaiassistedprediction |