Unsupervised detection of contextualized embedding bias with application to ideology
We propose a fully unsupervised method to detect bias in contextualized embeddings. The method leverages the assortative information latently encoded by social networks and combines orthogonality regularization, structured sparsity learning, and graph neural networks to find the embedding subspace c...
Main Authors: | Hofmann, V, Pierrehumbert, J, Schütze, H |
---|---|
Format: | Conference item |
Language: | English |
Published: |
Journal of Machine Learning Research
2022
|
Similar Items
-
Dynamic contextualized word embeddings
by: Hofmann, V, et al.
Published: (2021) -
Leveraging Bias in Pre-trained Word Embeddings for Unsupervised Microaggression Detection
by: Tolúlọpẹ́ Ògúnrẹ̀mí, et al.
Published: (2022-12-01) -
Forecasting COVID-19 caseloads using unsupervised embedding clusters of social media posts
by: Drinkall, F, et al.
Published: (2022) -
The Reddit Politosphere: a large-scale text and network resource of online political discourse
by: Hofmann, V, et al.
Published: (2022) -
DagoBERT: generating derivational morphology with a pretrained language model
by: Hofmann, V, et al.
Published: (2020)