Systematic review of machine learning methods applied to ecoacoustics and soundscape monitoring

Soundscape ecology is a promising area that studies landscape patterns based on their acoustic composition. It focuses on the distribution of biotic and abiotic sounds at different frequencies of the landscape acoustic attribute and the relationship of said sounds with ecosystem health metrics and i...

Full description

Bibliographic Details
Main Authors: D.A. Nieto-Mora, Susana Rodríguez-Buritica, Paula Rodríguez-Marín, J.D. Martínez-Vargaz, Claudia Isaza-Narváez
Format: Article
Language:English
Published: Elsevier 2023-10-01
Series:Heliyon
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2405844023074832
_version_ 1827780409009635328
author D.A. Nieto-Mora
Susana Rodríguez-Buritica
Paula Rodríguez-Marín
J.D. Martínez-Vargaz
Claudia Isaza-Narváez
author_facet D.A. Nieto-Mora
Susana Rodríguez-Buritica
Paula Rodríguez-Marín
J.D. Martínez-Vargaz
Claudia Isaza-Narváez
author_sort D.A. Nieto-Mora
collection DOAJ
description Soundscape ecology is a promising area that studies landscape patterns based on their acoustic composition. It focuses on the distribution of biotic and abiotic sounds at different frequencies of the landscape acoustic attribute and the relationship of said sounds with ecosystem health metrics and indicators (e.g., species richness, acoustic biodiversity, vectors of structural change, gradients of vegetation cover, landscape connectivity, and temporal and spatial characteristics). To conduct such studies, researchers analyze recordings from Acoustic Recording Units (ARUs). The increasing use of ARUs and their capacity to record hours of audio for months at a time have created a need for automatic processing methods to reduce time consumption, correlate variables implicit in the recordings, extract features, and characterize sound patterns related to landscape attributes. Consequently, traditional machine learning methods have been commonly used to process data on different characteristics of soundscapes, mainly the presence–absence of species. In addition, it has been employed for call segmentation, species identification, and sound source clustering. However, some authors highlight the importance of the new approaches that use unsupervised deep learning methods to improve the results and diversify the assessed attributes. In this paper, we present a systematic review of machine learning methods used in the field of ecoacoustics for data processing. It includes recent trends, such as semi-supervised and unsupervised deep learning methods. Moreover, it maintains the format found in the reviewed papers. First, we describe the ARUs employed in the papers analyzed, their configuration, and the study sites where the datasets were collected. Then, we provide an ecological justification that relates acoustic monitoring to landscape features. Subsequently, we explain the machine learning methods followed to assess various landscape attributes. The results show a trend towards label-free methods that can process the large volumes of data gathered in recent years. Finally, we discuss the need to adopt methods with a machine learning approach in other biological dimensions of landscapes.
first_indexed 2024-03-11T15:04:10Z
format Article
id doaj.art-c46bb3bb90c249d0a0a2612a6e1daa34
institution Directory Open Access Journal
issn 2405-8440
language English
last_indexed 2024-03-11T15:04:10Z
publishDate 2023-10-01
publisher Elsevier
record_format Article
series Heliyon
spelling doaj.art-c46bb3bb90c249d0a0a2612a6e1daa342023-10-30T06:05:36ZengElsevierHeliyon2405-84402023-10-01910e20275Systematic review of machine learning methods applied to ecoacoustics and soundscape monitoringD.A. Nieto-Mora0Susana Rodríguez-Buritica1Paula Rodríguez-Marín2J.D. Martínez-Vargaz3Claudia Isaza-Narváez4MIRP-Instituto Tecnológico Metropolitano ITM, Cl. 54a N∘30-01, Medellín, Colombia; Corresponding author.Instituto Alexander Von Humboldt, Calle 28A N∘15-09, Bogotá, ColombiaMIRP-Instituto Tecnológico Metropolitano ITM, Cl. 54a N∘30-01, Medellín, ColombiaUniversidad EAFIT, Cra 49, Cl. 7 Sur N∘50, Medellín, ColombiaSISTEMIC-Universidad de Antioquia UdeA, Cl. 67 N∘53-108, Medellín, ColombiaSoundscape ecology is a promising area that studies landscape patterns based on their acoustic composition. It focuses on the distribution of biotic and abiotic sounds at different frequencies of the landscape acoustic attribute and the relationship of said sounds with ecosystem health metrics and indicators (e.g., species richness, acoustic biodiversity, vectors of structural change, gradients of vegetation cover, landscape connectivity, and temporal and spatial characteristics). To conduct such studies, researchers analyze recordings from Acoustic Recording Units (ARUs). The increasing use of ARUs and their capacity to record hours of audio for months at a time have created a need for automatic processing methods to reduce time consumption, correlate variables implicit in the recordings, extract features, and characterize sound patterns related to landscape attributes. Consequently, traditional machine learning methods have been commonly used to process data on different characteristics of soundscapes, mainly the presence–absence of species. In addition, it has been employed for call segmentation, species identification, and sound source clustering. However, some authors highlight the importance of the new approaches that use unsupervised deep learning methods to improve the results and diversify the assessed attributes. In this paper, we present a systematic review of machine learning methods used in the field of ecoacoustics for data processing. It includes recent trends, such as semi-supervised and unsupervised deep learning methods. Moreover, it maintains the format found in the reviewed papers. First, we describe the ARUs employed in the papers analyzed, their configuration, and the study sites where the datasets were collected. Then, we provide an ecological justification that relates acoustic monitoring to landscape features. Subsequently, we explain the machine learning methods followed to assess various landscape attributes. The results show a trend towards label-free methods that can process the large volumes of data gathered in recent years. Finally, we discuss the need to adopt methods with a machine learning approach in other biological dimensions of landscapes.http://www.sciencedirect.com/science/article/pii/S2405844023074832Deep learningEcoacousticsEcological monitoringMachine learningSoundscape ecology
spellingShingle D.A. Nieto-Mora
Susana Rodríguez-Buritica
Paula Rodríguez-Marín
J.D. Martínez-Vargaz
Claudia Isaza-Narváez
Systematic review of machine learning methods applied to ecoacoustics and soundscape monitoring
Heliyon
Deep learning
Ecoacoustics
Ecological monitoring
Machine learning
Soundscape ecology
title Systematic review of machine learning methods applied to ecoacoustics and soundscape monitoring
title_full Systematic review of machine learning methods applied to ecoacoustics and soundscape monitoring
title_fullStr Systematic review of machine learning methods applied to ecoacoustics and soundscape monitoring
title_full_unstemmed Systematic review of machine learning methods applied to ecoacoustics and soundscape monitoring
title_short Systematic review of machine learning methods applied to ecoacoustics and soundscape monitoring
title_sort systematic review of machine learning methods applied to ecoacoustics and soundscape monitoring
topic Deep learning
Ecoacoustics
Ecological monitoring
Machine learning
Soundscape ecology
url http://www.sciencedirect.com/science/article/pii/S2405844023074832
work_keys_str_mv AT danietomora systematicreviewofmachinelearningmethodsappliedtoecoacousticsandsoundscapemonitoring
AT susanarodriguezburitica systematicreviewofmachinelearningmethodsappliedtoecoacousticsandsoundscapemonitoring
AT paularodriguezmarin systematicreviewofmachinelearningmethodsappliedtoecoacousticsandsoundscapemonitoring
AT jdmartinezvargaz systematicreviewofmachinelearningmethodsappliedtoecoacousticsandsoundscapemonitoring
AT claudiaisazanarvaez systematicreviewofmachinelearningmethodsappliedtoecoacousticsandsoundscapemonitoring