The medium is the message: toxicity declines in structured vs unstructured online deliberations

Humanity needs to deliberate effectively at scale about highly complex and contentious problems. Current online deliberation tools—such as email, chatrooms, and forums—are however plagued by levels of discussion toxicity that deeply undercut the willingness and ability of the participants to engage...

Full description

Bibliographic Details
Main Authors: Klein, Mark, Majdoubi, Nouhayla
Other Authors: Massachusetts Institute of Technology. Center for Collective Intelligence
Format: Article
Language:English
Published: Springer Science and Business Media LLC 2024
Online Access:https://hdl.handle.net/1721.1/154928
_version_ 1824458100603617280
author Klein, Mark
Majdoubi, Nouhayla
author2 Massachusetts Institute of Technology. Center for Collective Intelligence
author_facet Massachusetts Institute of Technology. Center for Collective Intelligence
Klein, Mark
Majdoubi, Nouhayla
author_sort Klein, Mark
collection MIT
description Humanity needs to deliberate effectively at scale about highly complex and contentious problems. Current online deliberation tools—such as email, chatrooms, and forums—are however plagued by levels of discussion toxicity that deeply undercut the willingness and ability of the participants to engage in thoughtful, meaningful, deliberations. This has led many organizations to either shut down their forums or invest in expensive, frequently unreliable, and ethically fraught moderation of people's contributions in their forums. This paper includes a comprehensive review on online toxicity, and describes how a structured deliberation process can substantially reduce toxicity compared to current approaches. The key underlying insight is that unstructured conversations create, especially at scale, an “attention wars” dynamic wherein people are often incented to resort to extremified language in order to get visibility for their postings. A structured deliberation process wherein people collaboratively create a compact organized collection of answers and arguments removes this underlying incentive, and results, in our evaluation, in a 50% reduction of high-toxicity posts.
first_indexed 2024-09-23T11:35:28Z
format Article
id mit-1721.1/154928
institution Massachusetts Institute of Technology
language English
last_indexed 2025-02-19T04:20:31Z
publishDate 2024
publisher Springer Science and Business Media LLC
record_format dspace
spelling mit-1721.1/1549282025-01-04T05:54:22Z The medium is the message: toxicity declines in structured vs unstructured online deliberations Klein, Mark Majdoubi, Nouhayla Massachusetts Institute of Technology. Center for Collective Intelligence Humanity needs to deliberate effectively at scale about highly complex and contentious problems. Current online deliberation tools—such as email, chatrooms, and forums—are however plagued by levels of discussion toxicity that deeply undercut the willingness and ability of the participants to engage in thoughtful, meaningful, deliberations. This has led many organizations to either shut down their forums or invest in expensive, frequently unreliable, and ethically fraught moderation of people's contributions in their forums. This paper includes a comprehensive review on online toxicity, and describes how a structured deliberation process can substantially reduce toxicity compared to current approaches. The key underlying insight is that unstructured conversations create, especially at scale, an “attention wars” dynamic wherein people are often incented to resort to extremified language in order to get visibility for their postings. A structured deliberation process wherein people collaboratively create a compact organized collection of answers and arguments removes this underlying incentive, and results, in our evaluation, in a 50% reduction of high-toxicity posts. 2024-05-13T16:18:09Z 2024-05-13T16:18:09Z 2024-05 2024-05-12T03:11:48Z Article http://purl.org/eprint/type/JournalArticle 1386-145X 1573-1413 https://hdl.handle.net/1721.1/154928 Klein, M., Majdoubi, N. The medium is the message: toxicity declines in structured vs unstructured online deliberations. World Wide Web 27, 31 (2024). PUBLISHER_CC en 10.1007/s11280-024-01269-0 World Wide Web Creative Commons Attribution https://creativecommons.org/licenses/by/4.0/ The Author(s) application/pdf Springer Science and Business Media LLC Springer US
spellingShingle Klein, Mark
Majdoubi, Nouhayla
The medium is the message: toxicity declines in structured vs unstructured online deliberations
title The medium is the message: toxicity declines in structured vs unstructured online deliberations
title_full The medium is the message: toxicity declines in structured vs unstructured online deliberations
title_fullStr The medium is the message: toxicity declines in structured vs unstructured online deliberations
title_full_unstemmed The medium is the message: toxicity declines in structured vs unstructured online deliberations
title_short The medium is the message: toxicity declines in structured vs unstructured online deliberations
title_sort medium is the message toxicity declines in structured vs unstructured online deliberations
url https://hdl.handle.net/1721.1/154928
work_keys_str_mv AT kleinmark themediumisthemessagetoxicitydeclinesinstructuredvsunstructuredonlinedeliberations
AT majdoubinouhayla themediumisthemessagetoxicitydeclinesinstructuredvsunstructuredonlinedeliberations
AT kleinmark mediumisthemessagetoxicitydeclinesinstructuredvsunstructuredonlinedeliberations
AT majdoubinouhayla mediumisthemessagetoxicitydeclinesinstructuredvsunstructuredonlinedeliberations