Unsupervised detection of contextualized embedding bias with application to ideology

Unsupervised detection of contextualized embedding bias with application to ideology

We propose a fully unsupervised method to detect bias in contextualized embeddings. The method leverages the assortative information latently encoded by social networks and combines orthogonality regularization, structured sparsity learning, and graph neural networks to find the embedding subspace c...

Bibliografske podrobnosti
Main Authors:	Hofmann, V, Pierrehumbert, J, Schütze, H
Format:	Conference item
Jezik:	English
Izdano:	Journal of Machine Learning Research 2022

Podobne knjige/članki

Dynamic contextualized word embeddings
od: Hofmann, V, et al.
Izdano: (2021)

Leveraging Bias in Pre-trained Word Embeddings for Unsupervised Microaggression Detection
od: Tolúlọpẹ́ Ògúnrẹ̀mí, et al.
Izdano: (2022-12-01)

Unsupervised Bitext Mining and Translation via Self-Trained Contextual Embeddings
od: Phillip Keung, et al.
Izdano: (2021-03-01)

Forecasting COVID-19 caseloads using unsupervised embedding clusters of social media posts
od: Drinkall, F, et al.
Izdano: (2022)

Modeling ideological salience and framing in polarized online groups with graph neural networks and structured sparsity
od: Hofmann, V, et al.
Izdano: (2022)

The Reddit Politosphere: a large-scale text and network resource of online political discourse
od: Hofmann, V, et al.
Izdano: (2022)

DagoBERT: generating derivational morphology with a pretrained language model
od: Hofmann, V, et al.
Izdano: (2020)

Predicting the growth of morphological families from social and linguistic factors
od: Hofmann, V, et al.
Izdano: (2020)

A graph auto-encoder model of derivational morphology
od: Hofmann, V, et al.
Izdano: (2020)

Unsupervised Modeling of Objects and Their Hierarchical Contextual Interactions
od: Tsuhan Chen, et al.
Izdano: (2009-01-01)

Contextualized embeddings for semantic change detection: Lessons learned
od: Andrey Kutuzov, et al.
Izdano: (2022-08-01)

(Predictable) performance bias in unsupervised anomaly detectionResearch in context
od: Felix Meissen, et al.
Izdano: (2024-03-01)

Unsupervised anomaly detection via dual transformation‐aware embeddings
od: Zhipeng Wang, et al.
Izdano: (2022-05-01)

Neural Network Pruning in Unsupervised Aspect Detection based on Aspect Embedding
od: Muhammad Haris Maulana, et al.
Izdano: (2022-10-01)

Unsupervised learning of object landmarks by factorized spatial embeddings
od: Thewlis, J, et al.
Izdano: (2017)

Contextual semantic embeddings for ontology subsumption prediction
od: Chen, J, et al.
Izdano: (2023)

Application of unsupervised clustering model based on graph embedding in water environment
od: Meng Fang, et al.
Izdano: (2023-12-01)

Social salience discriminates learnability of contextual cues in an artificial language
od: Rácz, P, et al.
Izdano: (2017)

Emotion Detection on Indonesian Tweets Using CNN and Contextualized Word Embedding
od: Heldiansyah, Muhammad Fikri, et al.
Izdano: (2022)

CNN Feature-Based Image Copy Detection with Contextual Hash Embedding
od: Zhili Zhou, et al.
Izdano: (2020-07-01)

Hate Speech Detection in Indonesian Twitter using Contextual Embedding Approach
od: Guntur Budi Herwanto, et al.
Izdano: (2021-04-01)

Embedding quantum into classical: contextualization vs conditionalization.
od: Ehtibar N Dzhafarov, et al.
Izdano: (2014-01-01)

Unsupervised land-use change detection using multi-temporal POI embedding
od: Yao, Yao, et al.
Izdano: (2024)

Contextual modulation of biases in face recognition.
od: Fatima Maria Felisberti, et al.
Izdano: (2010-09-01)

Geographic adaptation of pretrained language models
od: Hofmann, V, et al.
Izdano: (2024)

Fully-Unsupervised Embeddings-Based Hypernym Discovery
od: Maurizio Atzori, et al.
Izdano: (2020-05-01)

Principal Tensor Embedding for Unsupervised Tensor Learning
od: Claudio Turchetti, et al.
Izdano: (2020-01-01)

Unsupervised network embeddings with node identity awareness
od: Leonardo Gutiérrez-Gómez, et al.
Izdano: (2019-10-01)

Fast Unsupervised Graph Embedding Based on Anchors
od: YANG Hui, TAO Li-hong, ZHU Jian-yong, NIE Fei-ping
Izdano: (2022-04-01)

Unsupervised Named Entity Recognition Using Syntactic and Semantic Contextual Evidence
od: Alessandro Cucchiarelli, et al.
Izdano: (2021-03-01)

TransConv: Transformer Meets Contextual Convolution for Unsupervised Domain Adaptation
od: Junchi Liu, et al.
Izdano: (2024-05-01)

Quantum device fine-tuning using unsupervised embedding learning
od: van Esbroeck, NM, et al.
Izdano: (2020)

Quantum device fine-tuning using unsupervised embedding learning
od: N M van Esbroeck, et al.
Izdano: (2020-01-01)

Contextual Biasing for End-to-End Chinese ASR
od: Kai Zhang, et al.
Izdano: (2024-01-01)

Implicit prosody and contextual bias in silent reading
od: Kate McCurdy, et al.
Izdano: (2013-07-01)

Approximate personalized propagation for unsupervised embedding in heterogeneous graphs
od: Chen, Yibi, et al.
Izdano: (2022)

Unsupervised spatially embedded deep representation of spatial transcriptomics
od: Hang Xu, et al.
Izdano: (2024-01-01)

Unsupervised online multitask learning of behavioral sentence embeddings
od: Shao-Yen Tseng, et al.
Izdano: (2019-06-01)

Unsupervised Word Sense Disambiguation Using Word Embeddings
od: Behzad Moradi, et al.
Izdano: (2019-11-01)

Unsupervised Learning of Paragraph Embeddings for Context-Aware Recommendation
od: Jin Xie, et al.
Izdano: (2019-01-01)