On compositions of transformations in contrastive self-supervised learning

On compositions of transformations in contrastive self-supervised learning

In the image domain, excellent representations can be learned by inducing invariance to content-preserving transformations via noise contrastive learning. In this paper, we generalize contrastive learning to a wider set of transformations, and their compositions, for which either invariance or disti...

Bibliografske podrobnosti
Main Authors:	Yuki M. Asano, YM, Patrick, M, Kuznetsova, P, Fong, R, Henriques, JF, Zweig, G, Vedaldi, A
Format:	Conference item
Jezik:	English
Izdano:	IEEE 2022

Podobne knjige/članki

Labelling unlabelled videos from scratch with multi-modal self-supervision
od: Asano, YM, et al.
Izdano: (2020)

A critical analysis of self-supervision, or what we can learn from a single image
od: Asano, YM, et al.
Izdano: (2020)

PASS: An ImageNet replacement for self-supervised pretraining without humans
od: Asano, YM, et al.
Izdano: (2021)

Self-supervised and supervised contrastive learning
od: Tan, Alvin De Jun
Izdano: (2023)

Investigating Contrastive Pair Learning’s Frontiers in Supervised, Semisupervised, and Self-Supervised Learning
od: Bihi Sabiri, et al.
Izdano: (2024-08-01)

Contrastive self-supervised learning for neurodegenerative disorder classification
od: Vadym Gryshchuk, et al.
Izdano: (2025-02-01)

Contrastive lift: 3D object instance segmentation by slow-fast contrastive fusion
od: Bhalgat, Y, et al.
Izdano: (2024)

Self-supervised contrastive video-speech representation learning for ultrasound
od: Jiao, J, et al.
Izdano: (2020)

Support-set bottlenecks for video-text representation learning
od: Patrick, M, et al.
Izdano: (2021)

Keeping your eye on the ball: Trajectory attention in video transformers
od: Patrick, M, et al.
Izdano: (2021)

Contrastive Self-Supervised Learning for Globally Distributed Landslide Detection
od: Omid Ghorbanzadeh, et al.
Izdano: (2024-01-01)

Space-Time Crop & Attend: improving cross-modal video representation learning
od: Patrick, M, et al.
Izdano: (2022)

Cross pixel optical-flow similarity for self-supervised learning
od: Mahendran, A, et al.
Izdano: (2019)

Self-supervised learning of interpretable keypoints from unlabelled videos
od: Jakab, T, et al.
Izdano: (2020)

Attentive Self-supervised Contrastive Learning (ASCL) for plant disease classification
od: Getinet Yilma, et al.
Izdano: (2025-03-01)

An End-to-End Contrastive Self-Supervised Learning Framework for Language Understanding
od: Hongchao Fang, et al.
Izdano: (2022-12-01)

In-Domain Supervised and Contrastive Self-Supervised Representation Learning for Dense Prediction Problems in Remote Sensing Imageries
od: Ali Ghanbarzadeh, et al.
Izdano: (2024-01-01)

Self-supervised learning of geometrically stable features through probabilistic introspection
od: Novotny, D, et al.
Izdano: (2018)

Improved contrastive learning model via identification of false-negatives in self-supervised learning
od: Joonsun Auhn, et al.
Izdano: (2024-12-01)

Automated Screening of Precancerous Cervical Cells Through Contrastive Self-Supervised Learning
od: Jaewoo Chun, et al.
Izdano: (2024-11-01)

Dual-Channel Knowledge Tracing With Self-Supervised Contrastive and Directed Interaction Learning
od: Zuowei Zhang
Izdano: (2025-01-01)

Self-labelling via simultaneous clustering and representation learning
od: Vedaldi, A, et al.
Izdano: (2020)

Self-supervised segmentation by grouping optical-flow
od: Mahendran, A, et al.
Izdano: (2019)

Efficient deep learning-based automated diagnosis from echocardiography with contrastive self-supervised learning
od: Gregory Holste, et al.
Izdano: (2024-07-01)

Supervising the new with the old: Learning SFM from SFM
od: Klodt, M, et al.
Izdano: (2018)

Contrasting contrastive and supervised models interpretability
od: You, Yejin.
Izdano: (2021)

Contrastive Mask Learning for Self-Supervised 3D Skeleton-Based Action Recognition
od: Haoyuan Zhang
Izdano: (2025-02-01)

A method of synthetic spoofing speech detection using self-supervised contrastive learning
od: YANG Man, et al.
Izdano: (2024-11-01)

Self-Supervised Dam Deformation Anomaly Detection Based on Temporal–Spatial Contrast Learning
od: Yu Wang, et al.
Izdano: (2024-09-01)

Self-Supervised Contrastive Learning for Automated Segmentation of Brain Tumor MRI Images in Schizophrenia
od: Lingmiao Meng, et al.
Izdano: (2024-07-01)

Contrastive Self-Supervised Learning for Sensor-Based Human Activity Recognition: A Review
od: Hui Chen, et al.
Izdano: (2024-01-01)

Evaluating and Improving Domain Invariance in Contrastive Self-Supervised Learning by Extrapolating the Loss Function
od: Samira Zare, et al.
Izdano: (2023-01-01)

Moving SLAM: fully unsupervised deep learning in non-rigid scenes
od: Xu, D, et al.
Izdano: (2021)

Simple Data Transformations for Mitigating the Syntactic Similarity to Improve Sentence Embeddings at Supervised Contrastive Learning
od: Minji Kim, et al.
Izdano: (2024-08-01)

Enhancing breast cancer classification via histopathological image analysis: Leveraging self-supervised contrastive learning and transfer learning
od: Faisal Bin Ashraf, et al.
Izdano: (2024-01-01)

Boosting invariance and efficiency in supervised learning
od: Vedaldi, A, et al.
Izdano: (2007)

Negative-Sample-Free Contrastive Self-Supervised Learning for Electroencephalogram-Based Motor Imagery Classification
od: In-Nea Wang, et al.
Izdano: (2024-01-01)

Multi-Augmentation-Based Contrastive Learning for Semi-Supervised Learning
od: Jie Wang, et al.
Izdano: (2024-02-01)

Measuring the interpretability of unsupervised representations via quantized reversed probing
od: Laina, I, et al.
Izdano: (2021)

Quantum self-supervised learning
od: Jaderberg, B, et al.
Izdano: (2022)