Self-Supervised Transfer Learning from Natural Images for Sound Classification

Self-Supervised Transfer Learning from Natural Images for Sound Classification

We propose the implementation of transfer learning from natural images to audio-based images using self-supervised learning schemes. Through self-supervised learning, convolutional neural networks (CNNs) can learn the general representation of natural images without labels. In this study, a convolut...

Full description

Bibliographic Details
Main Authors:	Sungho Shin, Jongwon Kim, Yeonguk Yu, Seongju Lee, Kyoobin Lee
Format:	Article
Language:	English
Published:	MDPI AG 2021-03-01
Series:	Applied Sciences
Subjects:	deep learning sound event detection self-supervised learning transfer learning natural image
Online Access:	https://www.mdpi.com/2076-3417/11/7/3043

Similar Items

BattleSound: A Game Sound Benchmark for the Sound-Specific Feedback Generation in a Battle Game
by: Sungho Shin, et al.
Published: (2023-01-01)

Semi-Supervised NMF-CNN for Sound Event Detection
by: Teck Kai Chan, et al.
Published: (2021-01-01)

Weakly Supervised U-Net with Limited Upsampling for Sound Event Detection
by: Sangwon Lee, et al.
Published: (2023-06-01)

Transfer learning application of self-supervised learning in ARPES
by: Sandy Adhitia Ekahana, et al.
Published: (2023-01-01)

From Self-supervised Learning to Transfer Learning with Musculoskeletal Radiographs
by: Hinterwimmer Florian, et al.
Published: (2022-09-01)

Self-Supervised Learning for Solar Radio Spectrum Classification
by: Siqi Li, et al.
Published: (2022-12-01)

Classification of the Sidewalk Condition Using Self-Supervised Transfer Learning for Wheelchair Safety Driving
by: Ha-Yeong Yoon, et al.
Published: (2022-01-01)

Robust Skin Disease Classification by Distilling Deep Neural Network Ensemble for the Mobile Diagnosis of Herpes Zoster
by: Seunghyeok Back, et al.
Published: (2021-01-01)

Sound-Event Detection of Water-Usage Activities Using Transfer Learning
by: Seung Ho Hyun
Published: (2023-12-01)

Study on Human Activity Recognition Using Semi-Supervised Active Transfer Learning
by: Seungmin Oh, et al.
Published: (2021-04-01)

w2v-SELD: A Sound Event Localization and Detection Framework for Self-Supervised Spatial Audio Pre-Training
by: Orlem Lima Dos Santos, et al.
Published: (2024-01-01)

Patch-Level Consistency Regularization in Self-Supervised Transfer Learning for Fine-Grained Image Recognition
by: Yejin Lee, et al.
Published: (2023-09-01)

Abnormal Heart Sound Classification and Model Interpretability: A Transfer Learning Approach with Deep Learning
by: Milan Marocchi, et al.
Published: (2023-12-01)

Supervised contrastive pretrained ResNet with MixUp to enhance respiratory sound classification on imbalanced and limited dataset
by: Hu, Jinhai, et al.
Published: (2024)

Self-supervised in-domain representation learning for remote sensing image scene classification
by: Ali Ghanbarzadeh, et al.
Published: (2024-10-01)

Transfer learning for self-supervised, blind-spot seismic denoising
by: Claire Birnie, et al.
Published: (2022-12-01)

Self-Supervised Assisted Semi-Supervised Residual Network for Hyperspectral Image Classification
by: Liangliang Song, et al.
Published: (2022-06-01)

CLASSIFICATION BASED ON SEMI-SUPERVISED LEARNING: A REVIEW
by: Aska Ezadeen Mehyadin, et al.
Published: (2021-05-01)

Contrastive Self-Supervised Learning for Sensor-Based Human Activity Recognition: A Review
by: Hui Chen, et al.
Published: (2024-01-01)

Weakly Supervised Instance Segmentation Based on Two-Stage Transfer Learning
by: Yongqing Sun, et al.
Published: (2020-01-01)

Self-Supervised Encoders Are Better Transfer Learners in Remote Sensing Applications
by: Zachary D. Calhoun, et al.
Published: (2022-11-01)

Combining weakly and strongly supervised learning improves strong supervision in Gleason pattern classification
by: Sebastian Otálora, et al.
Published: (2021-05-01)

Research on Semi-Supervised Sound Event Detection Based on Mean Teacher Models Using ML-LoBCoD-NET
by: Jinjia Wang, et al.
Published: (2020-01-01)

DimCL: Dimensional Contrastive Learning for Improving Self-Supervised Learning
by: Thanh Nguyen, et al.
Published: (2023-01-01)

Image-Based Vehicle Classification by Synergizing Features from Supervised and Self-Supervised Learning Paradigms
by: Shihan Ma, et al.
Published: (2023-02-01)

Weak Supervised Sound Event Detection Based on Puzzle CAM
by: Xichang Cai, et al.
Published: (2023-01-01)

OVERVIEW OF COMPUTER VISION SUPERVISED LEARNING TECHNIQUES FOR LOW-DATA TRAINING
by: BURLACU, Alexandru
Published: (2020-12-01)

Study of implicit information semi-supervised learning algorithm
by: Guo-dong LIU, et al.
Published: (2015-10-01)

Study of implicit information semi-supervised learning algorithm
by: Guo-dong LIU, et al.
Published: (2015-10-01)

Deep Transfer Learning for Machine Diagnosis: From Sound and Music Recognition to Bearing Fault Detection
by: Eugenio Brusa, et al.
Published: (2021-12-01)

An improved self-supervised learning for EEG classification
by: Yanghan Ou, et al.
Published: (2022-05-01)

InverseTime: A Self-Supervised Technique for Semi-Supervised Classification of Time Series
by: Manuel Alejandro Goyo, et al.
Published: (2024-01-01)

Enhancing Retinal Blood Vessel Segmentation through Self-Supervised Pre-Training
by: José Morano, et al.
Published: (2020-08-01)

Self-Supervised Video Representation and Temporally Adaptive Attention for Audio-Visual Event Localization
by: Yue Ran, et al.
Published: (2022-12-01)

Audio-Based Emotion Recognition Using Self-Supervised Learning on an Engineered Feature Space
by: Peranut Nimitsurachat, et al.
Published: (2024-01-01)

An Enhanced Contrastive Ensemble Learning Method for Anomaly Sound Detection
by: Jingneng Liao, et al.
Published: (2025-02-01)

Classification of Ground-Based Cloud Images by Contrastive Self-Supervised Learning
by: Qi Lv, et al.
Published: (2022-11-01)

Shifting to machine supervision: annotation-efficient semi and self-supervised learning for automatic medical image segmentation and classification
by: Pranav Singh, et al.
Published: (2024-05-01)

A survey on heterogeneous transfer learning
by: Oscar Day, et al.
Published: (2017-09-01)

An Effective Representation Learning Approach: The Integrated Self-Supervised Pre-Training Models of StyleGAN2-ADA and DINO for Colon Polyp Images
by: Jong-Yeup Kim, et al.
Published: (2023-01-01)