Moderation, Networks, and Anti-Social Behavior Online

Major open platforms, such as Facebook, Twitter, Instagram, and Tik Tok, are bombarded with postings that violate platform community standards, offend societal norms, and cause harm to individuals and groups. To manage such sites requires identification of content and behavior that is anti-social an...

Full description

Bibliographic Details
Main Author: Caroline Haythornthwaite
Format: Article
Language:English
Published: SAGE Publishing 2023-09-01
Series:Social Media + Society
Online Access:https://doi.org/10.1177/20563051231196874
_version_ 1827816459498160128
author Caroline Haythornthwaite
author_facet Caroline Haythornthwaite
author_sort Caroline Haythornthwaite
collection DOAJ
description Major open platforms, such as Facebook, Twitter, Instagram, and Tik Tok, are bombarded with postings that violate platform community standards, offend societal norms, and cause harm to individuals and groups. To manage such sites requires identification of content and behavior that is anti-social and action to remove content and sanction posters. This process is not as straightforward as it seems: what is offensive and to whom varies by individual, group, and community; what action to take depends on stated standards, community expectations, and the extent of the offense; conversations can create and sustain anti-social behavior (ASB); networks of individuals can launch coordinated attacks; and fake accounts can side-step sanctioning behavior. In meeting the challenges of moderating extreme content, two guiding questions stand out: how do we define and identify ASB online? And, given the quantity and nuances of offensive content: how do we make the best use of automation and humans in the management of offending content and ASB? To address these questions, existing studies on ASB online were reviewed, and a detailed examination was made of social media moderation practices on major media. Pros and cons of automated and human review are discussed in a framework of three layers: environment, community, and crowd. Throughout, the article adds attention to the network impact of ASB, emphasizing the way ASB builds a relation between perpetrator(s) and victim(s), and can make ASB more or less offensive.
first_indexed 2024-03-12T00:19:54Z
format Article
id doaj.art-1498d5865c5f476f984c339fe9cc7eb9
institution Directory Open Access Journal
issn 2056-3051
language English
last_indexed 2024-03-12T00:19:54Z
publishDate 2023-09-01
publisher SAGE Publishing
record_format Article
series Social Media + Society
spelling doaj.art-1498d5865c5f476f984c339fe9cc7eb92023-09-15T13:33:33ZengSAGE PublishingSocial Media + Society2056-30512023-09-01910.1177/20563051231196874Moderation, Networks, and Anti-Social Behavior OnlineCaroline HaythornthwaiteMajor open platforms, such as Facebook, Twitter, Instagram, and Tik Tok, are bombarded with postings that violate platform community standards, offend societal norms, and cause harm to individuals and groups. To manage such sites requires identification of content and behavior that is anti-social and action to remove content and sanction posters. This process is not as straightforward as it seems: what is offensive and to whom varies by individual, group, and community; what action to take depends on stated standards, community expectations, and the extent of the offense; conversations can create and sustain anti-social behavior (ASB); networks of individuals can launch coordinated attacks; and fake accounts can side-step sanctioning behavior. In meeting the challenges of moderating extreme content, two guiding questions stand out: how do we define and identify ASB online? And, given the quantity and nuances of offensive content: how do we make the best use of automation and humans in the management of offending content and ASB? To address these questions, existing studies on ASB online were reviewed, and a detailed examination was made of social media moderation practices on major media. Pros and cons of automated and human review are discussed in a framework of three layers: environment, community, and crowd. Throughout, the article adds attention to the network impact of ASB, emphasizing the way ASB builds a relation between perpetrator(s) and victim(s), and can make ASB more or less offensive.https://doi.org/10.1177/20563051231196874
spellingShingle Caroline Haythornthwaite
Moderation, Networks, and Anti-Social Behavior Online
Social Media + Society
title Moderation, Networks, and Anti-Social Behavior Online
title_full Moderation, Networks, and Anti-Social Behavior Online
title_fullStr Moderation, Networks, and Anti-Social Behavior Online
title_full_unstemmed Moderation, Networks, and Anti-Social Behavior Online
title_short Moderation, Networks, and Anti-Social Behavior Online
title_sort moderation networks and anti social behavior online
url https://doi.org/10.1177/20563051231196874
work_keys_str_mv AT carolinehaythornthwaite moderationnetworksandantisocialbehavioronline