Computing moral hypotheticals
Our moral judgments depend on our ability to imagine what else might have happened: we forgive harms that prevent greater harms, we excuse bad outcomes when all others seem worse, and we condemn inaction when good actions are within reach. To explain how we do this, I built a computational model tha...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2022
|
| Online Access: | https://hdl.handle.net/1721.1/140141 |
| _version_ | 1826202667435687936 |
|---|---|
| author | Holmes, Dylan Alexander |
| author2 | Davis, Randall |
| author_facet | Davis, Randall Holmes, Dylan Alexander |
| author_sort | Holmes, Dylan Alexander |
| collection | MIT |
| description | Our moral judgments depend on our ability to imagine what else might have happened: we forgive harms that prevent greater harms, we excuse bad outcomes when all others seem worse, and we condemn inaction when good actions are within reach. To explain how we do this, I built a computational model that reads and evaluates short textual stories, computing hypotheticals in order to make moral judgments.
I identify what specialized knowledge we need in order to know which hypothetical alternatives to consider. I show how to connect abstract knowledge about moral harms to the particular details in a story. Finally, I show how the system can assess outcomes in a purely qualitative, human-like way by decomposing outcomes into their harmful components; I argue that—as in real life—many outcomes are incomparable.
I support my theoretical claims with references to the cognitive science and philosophical literature, and I demonstrate the system’s explanatory breadth with diverse examples including escalating revenge, slap-on-the-wrist, preventive harm, self-defense, and counterfactual dilemma resolution.
The key insight is that hypothetical context modulates understanding. With this system, I shed light on what is needed to grasp hypothetical context as effortlessly and automatically as we humans do. And I lay the groundwork for moral reasoning systems that are as nuanced, imaginative, and articulate as we humans are. |
| first_indexed | 2024-09-23T12:13:17Z |
| format | Thesis |
| id | mit-1721.1/140141 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T12:13:17Z |
| publishDate | 2022 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1401412022-02-08T03:36:38Z Computing moral hypotheticals Holmes, Dylan Alexander Davis, Randall Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Our moral judgments depend on our ability to imagine what else might have happened: we forgive harms that prevent greater harms, we excuse bad outcomes when all others seem worse, and we condemn inaction when good actions are within reach. To explain how we do this, I built a computational model that reads and evaluates short textual stories, computing hypotheticals in order to make moral judgments. I identify what specialized knowledge we need in order to know which hypothetical alternatives to consider. I show how to connect abstract knowledge about moral harms to the particular details in a story. Finally, I show how the system can assess outcomes in a purely qualitative, human-like way by decomposing outcomes into their harmful components; I argue that—as in real life—many outcomes are incomparable. I support my theoretical claims with references to the cognitive science and philosophical literature, and I demonstrate the system’s explanatory breadth with diverse examples including escalating revenge, slap-on-the-wrist, preventive harm, self-defense, and counterfactual dilemma resolution. The key insight is that hypothetical context modulates understanding. With this system, I shed light on what is needed to grasp hypothetical context as effortlessly and automatically as we humans do. And I lay the groundwork for moral reasoning systems that are as nuanced, imaginative, and articulate as we humans are. Ph.D. 2022-02-07T15:26:27Z 2022-02-07T15:26:27Z 2021-09 2021-09-21T19:30:51.633Z Thesis https://hdl.handle.net/1721.1/140141 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Holmes, Dylan Alexander Computing moral hypotheticals |
| title | Computing moral hypotheticals |
| title_full | Computing moral hypotheticals |
| title_fullStr | Computing moral hypotheticals |
| title_full_unstemmed | Computing moral hypotheticals |
| title_short | Computing moral hypotheticals |
| title_sort | computing moral hypotheticals |
| url | https://hdl.handle.net/1721.1/140141 |
| work_keys_str_mv | AT holmesdylanalexander computingmoralhypotheticals |