Adversarial masking for self-supervised learning

We propose ADIOS, a masked image modeling (MIM) framework for self-supervised learning, which simultaneously learns a masking function and an image encoder using an adversarial objective. The image encoder is trained to minimise the distance between representations of the original and that of a mask...

Full description

Bibliographic Details
Main Authors: Shi, Y, Siddharth, N, Torr, PHS, Kosiorek, AR
Format: Conference item
Language:English
Published: Journal of Machine Learning Research 2022