Generalized category discovery by Vaze, S, Han, K, Vedaldi, A, Zisserman, A

“…Next, we propose the use of vision transformers with contrastive representation learning for this open-world setting. We then introduce a simple yet effective semi-supervised k-means method to cluster the unlabelled data into seen and unseen classes automatically, substantially outperforming the baselines. …”

Learning with multimodal self-supervision by Chen, H

“…Finally, unlike existing audio-visual synchronization tasks performed on one specific domain, we propose to solve the synchronization problem in open world settings by exploring the use of several transformer-based architectures. …”