Algorithmic explanations: to become a mockingbird
<p>As algorithms are increasingly used to make potentially life-altering decisions the importance of ensuring they meet certain standards of fairness, accountability, and transparency is becoming paramount. Complex models that are poorly understood are susceptible to bias, reliance on protecte...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English |
| Published: |
2019
|
| Subjects: |
| _version_ | 1817933013483257856 |
|---|---|
| author | Hare, A |
| author2 | Van Kleek, M |
| author_facet | Van Kleek, M Hare, A |
| author_sort | Hare, A |
| collection | OXFORD |
| description | <p>As algorithms are increasingly used to make potentially life-altering decisions the importance of ensuring they meet certain standards of fairness, accountability, and transparency is becoming paramount. Complex models that are poorly understood are susceptible to bias, reliance on protected or irrelevant features, and adversarial examples. This concern has spawned interest in explainable and interpretable algorithms which allow humans to understand algorithmic decisions. Running parallel to this issue is an increasing reliance on algorithmically generated profiles to target advertisements online. Often these profiles are built on sensitive characteristics, without user knowledge or means of recourse. They can influence user perceptions of self, alter the content users are exposed to, and reveal to other parties characteristics which users have chosen not to share. This project aims to increase user autonomy and privacy online by leveraging techniques in explainable machine learning.</p> <p>This work begins by creating a prototype tool called Mockingbird that builds more than twenty algorithmically generated profiles based on Twitter data. These profiles are created using various techniques, including lexicons, neural networks, and Gaussian Processes. Mockingbird offers explanations for most of these profiles, primarily using a post-hoc explanatory tool. Finally, using synonym suggestions and techniques used to generate adversarial examples, Mockingbird gives users suggestions on how to alter their tweets in order to change their algorithmic profiles. Mockingbird is novel in combining profiles, explanations, and tools to change algorithmic profiles.</p> <p>The system was tested through several (n = 6) lab experiments to gauge user response to explanations and willingness to alter their data. It appears that users are generally not concerned about their algorithmic profiles when used for advertising, but would be much more concerned in higher stakes applications. Users were also unwilling to change their existing data to control algorithmically generated profiles, viewing the necessary changes as too disruptive to how they use social media. This work points to avenues of further research focusing explicitly on editing social media data to influence high stakes decisions such as job, visa, and loan applications.</p> |
| first_indexed | 2024-03-06T21:42:51Z |
| format | Thesis |
| id | oxford-uuid:48898f6d-f06e-4495-82a2-4a131758f097 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-12-09T03:47:03Z |
| publishDate | 2019 |
| record_format | dspace |
| spelling | oxford-uuid:48898f6d-f06e-4495-82a2-4a131758f0972024-12-08T09:40:31ZAlgorithmic explanations: to become a mockingbirdThesishttp://purl.org/coar/resource_type/c_bdccuuid:48898f6d-f06e-4495-82a2-4a131758f097computers in societyMachine learningEnglishORA Deposit2019Hare, AVan Kleek, M<p>As algorithms are increasingly used to make potentially life-altering decisions the importance of ensuring they meet certain standards of fairness, accountability, and transparency is becoming paramount. Complex models that are poorly understood are susceptible to bias, reliance on protected or irrelevant features, and adversarial examples. This concern has spawned interest in explainable and interpretable algorithms which allow humans to understand algorithmic decisions. Running parallel to this issue is an increasing reliance on algorithmically generated profiles to target advertisements online. Often these profiles are built on sensitive characteristics, without user knowledge or means of recourse. They can influence user perceptions of self, alter the content users are exposed to, and reveal to other parties characteristics which users have chosen not to share. This project aims to increase user autonomy and privacy online by leveraging techniques in explainable machine learning.</p> <p>This work begins by creating a prototype tool called Mockingbird that builds more than twenty algorithmically generated profiles based on Twitter data. These profiles are created using various techniques, including lexicons, neural networks, and Gaussian Processes. Mockingbird offers explanations for most of these profiles, primarily using a post-hoc explanatory tool. Finally, using synonym suggestions and techniques used to generate adversarial examples, Mockingbird gives users suggestions on how to alter their tweets in order to change their algorithmic profiles. Mockingbird is novel in combining profiles, explanations, and tools to change algorithmic profiles.</p> <p>The system was tested through several (n = 6) lab experiments to gauge user response to explanations and willingness to alter their data. It appears that users are generally not concerned about their algorithmic profiles when used for advertising, but would be much more concerned in higher stakes applications. Users were also unwilling to change their existing data to control algorithmically generated profiles, viewing the necessary changes as too disruptive to how they use social media. This work points to avenues of further research focusing explicitly on editing social media data to influence high stakes decisions such as job, visa, and loan applications.</p> |
| spellingShingle | computers in society Machine learning Hare, A Algorithmic explanations: to become a mockingbird |
| title | Algorithmic explanations: to become a mockingbird |
| title_full | Algorithmic explanations: to become a mockingbird |
| title_fullStr | Algorithmic explanations: to become a mockingbird |
| title_full_unstemmed | Algorithmic explanations: to become a mockingbird |
| title_short | Algorithmic explanations: to become a mockingbird |
| title_sort | algorithmic explanations to become a mockingbird |
| topic | computers in society Machine learning |
| work_keys_str_mv | AT harea algorithmicexplanationstobecomeamockingbird |