Machine morality, moral progress, and the looming environmental disaster

The creation of artificial moral systems requires making difficult choices about which of varying human value sets should be instantiated. The industry-standard approach is to seek and encode moral consensus. Here the authors' argue, based on evidence from empirical psychology, that encoding cu...

Full description

Bibliographic Details
Main Authors: Kenward, B, Sinclair, T
Format: Journal article
Language:English
Published: Wiley 2021
_version_ 1797095063195484160
author Kenward, B
Sinclair, T
author_facet Kenward, B
Sinclair, T
author_sort Kenward, B
collection OXFORD
description The creation of artificial moral systems requires making difficult choices about which of varying human value sets should be instantiated. The industry-standard approach is to seek and encode moral consensus. Here the authors' argue, based on evidence from empirical psychology, that encoding current moral consensus risks reinforcing current norms, and thus inhibiting moral progress. However, so do efforts to encode progressive norms. Machine ethics is thus caught between a rock and a hard place. The problem is particularly acute when progress beyond prevailing moral norms is particularly urgent, as is currently the case due to the inadequacy of prevailing moral norms in the face of the climate and ecological crisis.
first_indexed 2024-03-07T04:22:41Z
format Journal article
id oxford-uuid:cb8ed61c-35f0-4125-8849-f0c348ba445d
institution University of Oxford
language English
last_indexed 2024-03-07T04:22:41Z
publishDate 2021
publisher Wiley
record_format dspace
spelling oxford-uuid:cb8ed61c-35f0-4125-8849-f0c348ba445d2022-03-27T07:15:42ZMachine morality, moral progress, and the looming environmental disasterJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:cb8ed61c-35f0-4125-8849-f0c348ba445dEnglishSymplectic ElementsWiley2021Kenward, BSinclair, TThe creation of artificial moral systems requires making difficult choices about which of varying human value sets should be instantiated. The industry-standard approach is to seek and encode moral consensus. Here the authors' argue, based on evidence from empirical psychology, that encoding current moral consensus risks reinforcing current norms, and thus inhibiting moral progress. However, so do efforts to encode progressive norms. Machine ethics is thus caught between a rock and a hard place. The problem is particularly acute when progress beyond prevailing moral norms is particularly urgent, as is currently the case due to the inadequacy of prevailing moral norms in the face of the climate and ecological crisis.
spellingShingle Kenward, B
Sinclair, T
Machine morality, moral progress, and the looming environmental disaster
title Machine morality, moral progress, and the looming environmental disaster
title_full Machine morality, moral progress, and the looming environmental disaster
title_fullStr Machine morality, moral progress, and the looming environmental disaster
title_full_unstemmed Machine morality, moral progress, and the looming environmental disaster
title_short Machine morality, moral progress, and the looming environmental disaster
title_sort machine morality moral progress and the looming environmental disaster
work_keys_str_mv AT kenwardb machinemoralitymoralprogressandtheloomingenvironmentaldisaster
AT sinclairt machinemoralitymoralprogressandtheloomingenvironmentaldisaster