A New Method for Detecting Onset and Offset for Singing in Real-Time and Offline Environments

This paper introduces a new method for detecting onsets, offsets, and transitions of the notes in real-time solo singing performances. It identifies the onsets and offsets by finding the transitions from one note to another by considering trajectory changes in the fundamental frequencies. The accura...

Full description

Bibliographic Details
Main Authors: Behnam Faghih, Sutirtha Chakraborty, Azeema Yaseen, Joseph Timoney
Format: Article
Language:English
Published: MDPI AG 2022-07-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/12/15/7391
_version_ 1797442966360424448
author Behnam Faghih
Sutirtha Chakraborty
Azeema Yaseen
Joseph Timoney
author_facet Behnam Faghih
Sutirtha Chakraborty
Azeema Yaseen
Joseph Timoney
author_sort Behnam Faghih
collection DOAJ
description This paper introduces a new method for detecting onsets, offsets, and transitions of the notes in real-time solo singing performances. It identifies the onsets and offsets by finding the transitions from one note to another by considering trajectory changes in the fundamental frequencies. The accuracy of our approach is compared with eight well-known algorithms. It was tested with two datasets that contained 130 files of singing. The total duration of the datasets was more than seven hours and had more than 41,000 onset annotations. The analysis metrics used include the Average, the F-Measure Score, and ANOVA. The proposed algorithm was observed to determine onsets and offsets more accurately than the other algorithms. Additionally, unlike the other algorithms, the proposed algorithm can detect the transitions between notes.
first_indexed 2024-03-09T12:50:14Z
format Article
id doaj.art-ad864a0996d64921acf725966fc76cd9
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-09T12:50:14Z
publishDate 2022-07-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-ad864a0996d64921acf725966fc76cd92023-11-30T22:08:18ZengMDPI AGApplied Sciences2076-34172022-07-011215739110.3390/app12157391A New Method for Detecting Onset and Offset for Singing in Real-Time and Offline EnvironmentsBehnam Faghih0Sutirtha Chakraborty1Azeema Yaseen2Joseph Timoney3Department of Computer Science, Maynooth University, W23 F2H6 Maynooth, Co. Kildare, IrelandDepartment of Computer Science, Maynooth University, W23 F2H6 Maynooth, Co. Kildare, IrelandDepartment of Computer Science, Maynooth University, W23 F2H6 Maynooth, Co. Kildare, IrelandDepartment of Computer Science, Maynooth University, W23 F2H6 Maynooth, Co. Kildare, IrelandThis paper introduces a new method for detecting onsets, offsets, and transitions of the notes in real-time solo singing performances. It identifies the onsets and offsets by finding the transitions from one note to another by considering trajectory changes in the fundamental frequencies. The accuracy of our approach is compared with eight well-known algorithms. It was tested with two datasets that contained 130 files of singing. The total duration of the datasets was more than seven hours and had more than 41,000 onset annotations. The analysis metrics used include the Average, the F-Measure Score, and ANOVA. The proposed algorithm was observed to determine onsets and offsets more accurately than the other algorithms. Additionally, unlike the other algorithms, the proposed algorithm can detect the transitions between notes.https://www.mdpi.com/2076-3417/12/15/7391real-time onset detectionsinging signal processingnote extractionsinging information retrieval
spellingShingle Behnam Faghih
Sutirtha Chakraborty
Azeema Yaseen
Joseph Timoney
A New Method for Detecting Onset and Offset for Singing in Real-Time and Offline Environments
Applied Sciences
real-time onset detection
singing signal processing
note extraction
singing information retrieval
title A New Method for Detecting Onset and Offset for Singing in Real-Time and Offline Environments
title_full A New Method for Detecting Onset and Offset for Singing in Real-Time and Offline Environments
title_fullStr A New Method for Detecting Onset and Offset for Singing in Real-Time and Offline Environments
title_full_unstemmed A New Method for Detecting Onset and Offset for Singing in Real-Time and Offline Environments
title_short A New Method for Detecting Onset and Offset for Singing in Real-Time and Offline Environments
title_sort new method for detecting onset and offset for singing in real time and offline environments
topic real-time onset detection
singing signal processing
note extraction
singing information retrieval
url https://www.mdpi.com/2076-3417/12/15/7391
work_keys_str_mv AT behnamfaghih anewmethodfordetectingonsetandoffsetforsinginginrealtimeandofflineenvironments
AT sutirthachakraborty anewmethodfordetectingonsetandoffsetforsinginginrealtimeandofflineenvironments
AT azeemayaseen anewmethodfordetectingonsetandoffsetforsinginginrealtimeandofflineenvironments
AT josephtimoney anewmethodfordetectingonsetandoffsetforsinginginrealtimeandofflineenvironments
AT behnamfaghih newmethodfordetectingonsetandoffsetforsinginginrealtimeandofflineenvironments
AT sutirthachakraborty newmethodfordetectingonsetandoffsetforsinginginrealtimeandofflineenvironments
AT azeemayaseen newmethodfordetectingonsetandoffsetforsinginginrealtimeandofflineenvironments
AT josephtimoney newmethodfordetectingonsetandoffsetforsinginginrealtimeandofflineenvironments