Unsupervised detection of contextualized embedding bias with application to ideology

Unsupervised detection of contextualized embedding bias with application to ideology

We propose a fully unsupervised method to detect bias in contextualized embeddings. The method leverages the assortative information latently encoded by social networks and combines orthogonality regularization, structured sparsity learning, and graph neural networks to find the embedding subspace c...

Fuld beskrivelse

Bibliografiske detaljer
Main Authors:	Hofmann, V, Pierrehumbert, J, Schütze, H
Format:	Conference item
Sprog:	English
Udgivet:	Journal of Machine Learning Research 2022

Lignende værker

Dynamic contextualized word embeddings
af: Hofmann, V, et al.
Udgivet: (2021)

Leveraging Bias in Pre-trained Word Embeddings for Unsupervised Microaggression Detection
af: Tolúlọpẹ́ Ògúnrẹ̀mí, et al.
Udgivet: (2022-12-01)

Unsupervised Bitext Mining and Translation via Self-Trained Contextual Embeddings
af: Phillip Keung, et al.
Udgivet: (2021-03-01)

Forecasting COVID-19 caseloads using unsupervised embedding clusters of social media posts
af: Drinkall, F, et al.
Udgivet: (2022)

Modeling ideological salience and framing in polarized online groups with graph neural networks and structured sparsity
af: Hofmann, V, et al.
Udgivet: (2022)

The Reddit Politosphere: a large-scale text and network resource of online political discourse
af: Hofmann, V, et al.
Udgivet: (2022)

DagoBERT: generating derivational morphology with a pretrained language model
af: Hofmann, V, et al.
Udgivet: (2020)

Predicting the growth of morphological families from social and linguistic factors
af: Hofmann, V, et al.
Udgivet: (2020)

A graph auto-encoder model of derivational morphology
af: Hofmann, V, et al.
Udgivet: (2020)

Unsupervised Modeling of Objects and Their Hierarchical Contextual Interactions
af: Tsuhan Chen, et al.
Udgivet: (2009-01-01)

Contextualized embeddings for semantic change detection: Lessons learned
af: Andrey Kutuzov, et al.
Udgivet: (2022-08-01)

(Predictable) performance bias in unsupervised anomaly detectionResearch in context
af: Felix Meissen, et al.
Udgivet: (2024-03-01)

Unsupervised anomaly detection via dual transformation‐aware embeddings
af: Zhipeng Wang, et al.
Udgivet: (2022-05-01)

Neural Network Pruning in Unsupervised Aspect Detection based on Aspect Embedding
af: Muhammad Haris Maulana, et al.
Udgivet: (2022-10-01)

Unsupervised learning of object landmarks by factorized spatial embeddings
af: Thewlis, J, et al.
Udgivet: (2017)

Contextual semantic embeddings for ontology subsumption prediction
af: Chen, J, et al.
Udgivet: (2023)

Application of unsupervised clustering model based on graph embedding in water environment
af: Meng Fang, et al.
Udgivet: (2023-12-01)

Social salience discriminates learnability of contextual cues in an artificial language
af: Rácz, P, et al.
Udgivet: (2017)

Emotion Detection on Indonesian Tweets Using CNN and Contextualized Word Embedding
af: Heldiansyah, Muhammad Fikri, et al.
Udgivet: (2022)

CNN Feature-Based Image Copy Detection with Contextual Hash Embedding
af: Zhili Zhou, et al.
Udgivet: (2020-07-01)

Hate Speech Detection in Indonesian Twitter using Contextual Embedding Approach
af: Guntur Budi Herwanto, et al.
Udgivet: (2021-04-01)

Embedding quantum into classical: contextualization vs conditionalization.
af: Ehtibar N Dzhafarov, et al.
Udgivet: (2014-01-01)

Unsupervised land-use change detection using multi-temporal POI embedding
af: Yao, Yao, et al.
Udgivet: (2024)

Contextual modulation of biases in face recognition.
af: Fatima Maria Felisberti, et al.
Udgivet: (2010-09-01)

Geographic adaptation of pretrained language models
af: Hofmann, V, et al.
Udgivet: (2024)

Fully-Unsupervised Embeddings-Based Hypernym Discovery
af: Maurizio Atzori, et al.
Udgivet: (2020-05-01)

Principal Tensor Embedding for Unsupervised Tensor Learning
af: Claudio Turchetti, et al.
Udgivet: (2020-01-01)

Unsupervised network embeddings with node identity awareness
af: Leonardo Gutiérrez-Gómez, et al.
Udgivet: (2019-10-01)

Fast Unsupervised Graph Embedding Based on Anchors
af: YANG Hui, TAO Li-hong, ZHU Jian-yong, NIE Fei-ping
Udgivet: (2022-04-01)

Unsupervised Named Entity Recognition Using Syntactic and Semantic Contextual Evidence
af: Alessandro Cucchiarelli, et al.
Udgivet: (2021-03-01)

TransConv: Transformer Meets Contextual Convolution for Unsupervised Domain Adaptation
af: Junchi Liu, et al.
Udgivet: (2024-05-01)

Quantum device fine-tuning using unsupervised embedding learning
af: van Esbroeck, NM, et al.
Udgivet: (2020)

Quantum device fine-tuning using unsupervised embedding learning
af: N M van Esbroeck, et al.
Udgivet: (2020-01-01)

Contextual Biasing for End-to-End Chinese ASR
af: Kai Zhang, et al.
Udgivet: (2024-01-01)

Implicit prosody and contextual bias in silent reading
af: Kate McCurdy, et al.
Udgivet: (2013-07-01)

Approximate personalized propagation for unsupervised embedding in heterogeneous graphs
af: Chen, Yibi, et al.
Udgivet: (2022)

Unsupervised spatially embedded deep representation of spatial transcriptomics
af: Hang Xu, et al.
Udgivet: (2024-01-01)

Unsupervised online multitask learning of behavioral sentence embeddings
af: Shao-Yen Tseng, et al.
Udgivet: (2019-06-01)

Unsupervised Word Sense Disambiguation Using Word Embeddings
af: Behzad Moradi, et al.
Udgivet: (2019-11-01)

Unsupervised Learning of Paragraph Embeddings for Context-Aware Recommendation
af: Jin Xie, et al.
Udgivet: (2019-01-01)