Unsupervised detection of contextualized embedding bias with application to ideology

Unsupervised detection of contextualized embedding bias with application to ideology

We propose a fully unsupervised method to detect bias in contextualized embeddings. The method leverages the assortative information latently encoded by social networks and combines orthogonality regularization, structured sparsity learning, and graph neural networks to find the embedding subspace c...

Полное описание

Библиографические подробности
Главные авторы:	Hofmann, V, Pierrehumbert, J, Schütze, H
Формат:	Conference item
Язык:	English
Опубликовано:	Journal of Machine Learning Research 2022

Схожие документы

Dynamic contextualized word embeddings
по: Hofmann, V, и др.
Опубликовано: (2021)

Leveraging Bias in Pre-trained Word Embeddings for Unsupervised Microaggression Detection
по: Tolúlọpẹ́ Ògúnrẹ̀mí, и др.
Опубликовано: (2022-12-01)

Unsupervised Bitext Mining and Translation via Self-Trained Contextual Embeddings
по: Phillip Keung, и др.
Опубликовано: (2021-03-01)

Forecasting COVID-19 caseloads using unsupervised embedding clusters of social media posts
по: Drinkall, F, и др.
Опубликовано: (2022)

Modeling ideological salience and framing in polarized online groups with graph neural networks and structured sparsity
по: Hofmann, V, и др.
Опубликовано: (2022)

The Reddit Politosphere: a large-scale text and network resource of online political discourse
по: Hofmann, V, и др.
Опубликовано: (2022)

DagoBERT: generating derivational morphology with a pretrained language model
по: Hofmann, V, и др.
Опубликовано: (2020)

Predicting the growth of morphological families from social and linguistic factors
по: Hofmann, V, и др.
Опубликовано: (2020)

A graph auto-encoder model of derivational morphology
по: Hofmann, V, и др.
Опубликовано: (2020)

Unsupervised Modeling of Objects and Their Hierarchical Contextual Interactions
по: Tsuhan Chen, и др.
Опубликовано: (2009-01-01)

Contextualized embeddings for semantic change detection: Lessons learned
по: Andrey Kutuzov, и др.
Опубликовано: (2022-08-01)

(Predictable) performance bias in unsupervised anomaly detectionResearch in context
по: Felix Meissen, и др.
Опубликовано: (2024-03-01)

Unsupervised anomaly detection via dual transformation‐aware embeddings
по: Zhipeng Wang, и др.
Опубликовано: (2022-05-01)

Neural Network Pruning in Unsupervised Aspect Detection based on Aspect Embedding
по: Muhammad Haris Maulana, и др.
Опубликовано: (2022-10-01)

Unsupervised learning of object landmarks by factorized spatial embeddings
по: Thewlis, J, и др.
Опубликовано: (2017)

Contextual semantic embeddings for ontology subsumption prediction
по: Chen, J, и др.
Опубликовано: (2023)

Application of unsupervised clustering model based on graph embedding in water environment
по: Meng Fang, и др.
Опубликовано: (2023-12-01)

Social salience discriminates learnability of contextual cues in an artificial language
по: Rácz, P, и др.
Опубликовано: (2017)

Emotion Detection on Indonesian Tweets Using CNN and Contextualized Word Embedding
по: Heldiansyah, Muhammad Fikri, и др.
Опубликовано: (2022)

CNN Feature-Based Image Copy Detection with Contextual Hash Embedding
по: Zhili Zhou, и др.
Опубликовано: (2020-07-01)

Hate Speech Detection in Indonesian Twitter using Contextual Embedding Approach
по: Guntur Budi Herwanto, и др.
Опубликовано: (2021-04-01)

Embedding quantum into classical: contextualization vs conditionalization.
по: Ehtibar N Dzhafarov, и др.
Опубликовано: (2014-01-01)

Unsupervised land-use change detection using multi-temporal POI embedding
по: Yao, Yao, и др.
Опубликовано: (2024)

Contextual modulation of biases in face recognition.
по: Fatima Maria Felisberti, и др.
Опубликовано: (2010-09-01)

Geographic adaptation of pretrained language models
по: Hofmann, V, и др.
Опубликовано: (2024)

Fully-Unsupervised Embeddings-Based Hypernym Discovery
по: Maurizio Atzori, и др.
Опубликовано: (2020-05-01)

Principal Tensor Embedding for Unsupervised Tensor Learning
по: Claudio Turchetti, и др.
Опубликовано: (2020-01-01)

Unsupervised network embeddings with node identity awareness
по: Leonardo Gutiérrez-Gómez, и др.
Опубликовано: (2019-10-01)

Fast Unsupervised Graph Embedding Based on Anchors
по: YANG Hui, TAO Li-hong, ZHU Jian-yong, NIE Fei-ping
Опубликовано: (2022-04-01)

Unsupervised Named Entity Recognition Using Syntactic and Semantic Contextual Evidence
по: Alessandro Cucchiarelli, и др.
Опубликовано: (2021-03-01)

TransConv: Transformer Meets Contextual Convolution for Unsupervised Domain Adaptation
по: Junchi Liu, и др.
Опубликовано: (2024-05-01)

Quantum device fine-tuning using unsupervised embedding learning
по: van Esbroeck, NM, и др.
Опубликовано: (2020)

Quantum device fine-tuning using unsupervised embedding learning
по: N M van Esbroeck, и др.
Опубликовано: (2020-01-01)

Contextual Biasing for End-to-End Chinese ASR
по: Kai Zhang, и др.
Опубликовано: (2024-01-01)

Implicit prosody and contextual bias in silent reading
по: Kate McCurdy, и др.
Опубликовано: (2013-07-01)

Approximate personalized propagation for unsupervised embedding in heterogeneous graphs
по: Chen, Yibi, и др.
Опубликовано: (2022)

Unsupervised spatially embedded deep representation of spatial transcriptomics
по: Hang Xu, и др.
Опубликовано: (2024-01-01)

Unsupervised online multitask learning of behavioral sentence embeddings
по: Shao-Yen Tseng, и др.
Опубликовано: (2019-06-01)

Unsupervised Word Sense Disambiguation Using Word Embeddings
по: Behzad Moradi, и др.
Опубликовано: (2019-11-01)

Unsupervised Learning of Paragraph Embeddings for Context-Aware Recommendation
по: Jin Xie, и др.
Опубликовано: (2019-01-01)