The artificial moral advisor: the "ideal observer" meets artificial intelligence
We describe a form of moral artificial intelligence that could be used to improve human moral decision-making. We call it the “artificial moral advisor” (AMA). The AMA would implement a quasi-relativistic version of the “ideal observer” famously described by Roderick Firth. We describe similarities...
| Main Authors: | , |
|---|---|
| Format: | Journal article |
| Published: |
Springer Netherlands
2017
|
| _version_ | 1826272302388477952 |
|---|---|
| author | Giubilini, A Savulescu, J |
| author_facet | Giubilini, A Savulescu, J |
| author_sort | Giubilini, A |
| collection | OXFORD |
| description | We describe a form of moral artificial intelligence that could be used to improve human moral decision-making. We call it the “artificial moral advisor” (AMA). The AMA would implement a quasi-relativistic version of the “ideal observer” famously described by Roderick Firth. We describe similarities and differences between the AMA and Firth’s ideal observer. Like Firth’s ideal observer, the AMA is disinterested, dispassionate, and consistent in its judgments. Unlike Firth’s observer, the AMA is non-absolutist, because it would take into account the human agent’s own principles and values. We argue that the AMA would respect and indeed enhance individuals’ moral autonomy, help individuals achieve wide and a narrow reflective equilibrium, make up for the limitations of human moral psychology in a way that takes conservatives’ objections to human bioenhancement seriously, and implement the positive functions of intuitions and emotions in human morality without their downsides, such as biases and prejudices. |
| first_indexed | 2024-03-06T22:10:24Z |
| format | Journal article |
| id | oxford-uuid:519b5f2f-91af-4090-98aa-258d2dc967c0 |
| institution | University of Oxford |
| last_indexed | 2024-03-06T22:10:24Z |
| publishDate | 2017 |
| publisher | Springer Netherlands |
| record_format | dspace |
| spelling | oxford-uuid:519b5f2f-91af-4090-98aa-258d2dc967c02022-03-26T16:20:36ZThe artificial moral advisor: the "ideal observer" meets artificial intelligenceJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:519b5f2f-91af-4090-98aa-258d2dc967c0Symplectic Elements at OxfordSpringer Netherlands2017Giubilini, ASavulescu, JWe describe a form of moral artificial intelligence that could be used to improve human moral decision-making. We call it the “artificial moral advisor” (AMA). The AMA would implement a quasi-relativistic version of the “ideal observer” famously described by Roderick Firth. We describe similarities and differences between the AMA and Firth’s ideal observer. Like Firth’s ideal observer, the AMA is disinterested, dispassionate, and consistent in its judgments. Unlike Firth’s observer, the AMA is non-absolutist, because it would take into account the human agent’s own principles and values. We argue that the AMA would respect and indeed enhance individuals’ moral autonomy, help individuals achieve wide and a narrow reflective equilibrium, make up for the limitations of human moral psychology in a way that takes conservatives’ objections to human bioenhancement seriously, and implement the positive functions of intuitions and emotions in human morality without their downsides, such as biases and prejudices. |
| spellingShingle | Giubilini, A Savulescu, J The artificial moral advisor: the "ideal observer" meets artificial intelligence |
| title | The artificial moral advisor: the "ideal observer" meets artificial intelligence |
| title_full | The artificial moral advisor: the "ideal observer" meets artificial intelligence |
| title_fullStr | The artificial moral advisor: the "ideal observer" meets artificial intelligence |
| title_full_unstemmed | The artificial moral advisor: the "ideal observer" meets artificial intelligence |
| title_short | The artificial moral advisor: the "ideal observer" meets artificial intelligence |
| title_sort | artificial moral advisor the ideal observer meets artificial intelligence |
| work_keys_str_mv | AT giubilinia theartificialmoraladvisortheidealobservermeetsartificialintelligence AT savulescuj theartificialmoraladvisortheidealobservermeetsartificialintelligence AT giubilinia artificialmoraladvisortheidealobservermeetsartificialintelligence AT savulescuj artificialmoraladvisortheidealobservermeetsartificialintelligence |