Korean Pansori Vocal Note Transcription Using Attention-Based Segmentation and Viterbi Decoding
In this paper, first, we delved into the experiment by comparing various attention mechanisms in the semantic pixel-wise segmentation framework to perform frame-level transcription tasks. Second, the Viterbi algorithm was utilized by transferring the knowledge of the frame-level transcription model...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-01-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/14/2/492 |
| _version_ | 1797340227261431808 |
|---|---|
| author | Bhuwan Bhattarai Joonwhoan Lee |
| author_facet | Bhuwan Bhattarai Joonwhoan Lee |
| author_sort | Bhuwan Bhattarai |
| collection | DOAJ |
| description | In this paper, first, we delved into the experiment by comparing various attention mechanisms in the semantic pixel-wise segmentation framework to perform frame-level transcription tasks. Second, the Viterbi algorithm was utilized by transferring the knowledge of the frame-level transcription model to obtain the vocal notes of Korean Pansori. We considered a semantic pixel-wise segmentation framework for frame-level transcription as the source task and a Viterbi algorithm-based Korean Pansori note-level transcription as the target task. The primary goal of this paper was to transcribe the vocal notes of Pansori music, a traditional Korean art form. To achieve this goal, the initial step involved conducting the experiments with the source task, where a trained model was employed for vocal melody extraction. To achieve the desired vocal note transcription for the target task, the Viterbi algorithm was utilized with the frame-level transcription model. By leveraging this approach, we sought to accurately transcribe the vocal notes present in Pansori performances. The effectiveness of our attention-based segmentation methods for frame-level transcription in the source task has been compared with various algorithms using the vocal melody task of the MedleyDB dataset, enabling us to measure the voicing recall, voicing false alarm, raw pitch accuracy, raw chroma accuracy, and overall accuracy. The results of our experiments highlight the significance of attention mechanisms for enhancing the performance of frame-level music transcription models. We also conducted a visual and subjective comparison to evaluate the results of the target task for vocal note transcription. Since there was no ground truth vocal note for Pansori, this analysis provides valuable insights into the preservation and appreciation of this culturally rich art form. |
| first_indexed | 2024-03-08T09:59:57Z |
| format | Article |
| id | doaj.art-8cec638c3bea437e8841103186c2d1d3 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-08T09:59:57Z |
| publishDate | 2024-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-8cec638c3bea437e8841103186c2d1d32024-01-29T13:41:59ZengMDPI AGApplied Sciences2076-34172024-01-0114249210.3390/app14020492Korean Pansori Vocal Note Transcription Using Attention-Based Segmentation and Viterbi DecodingBhuwan Bhattarai0Joonwhoan Lee1Center for Advanced Image and Information Technology, Jeonbuk National University, Jeonju 54896, Republic of KoreaCenter for Advanced Image and Information Technology, Jeonbuk National University, Jeonju 54896, Republic of KoreaIn this paper, first, we delved into the experiment by comparing various attention mechanisms in the semantic pixel-wise segmentation framework to perform frame-level transcription tasks. Second, the Viterbi algorithm was utilized by transferring the knowledge of the frame-level transcription model to obtain the vocal notes of Korean Pansori. We considered a semantic pixel-wise segmentation framework for frame-level transcription as the source task and a Viterbi algorithm-based Korean Pansori note-level transcription as the target task. The primary goal of this paper was to transcribe the vocal notes of Pansori music, a traditional Korean art form. To achieve this goal, the initial step involved conducting the experiments with the source task, where a trained model was employed for vocal melody extraction. To achieve the desired vocal note transcription for the target task, the Viterbi algorithm was utilized with the frame-level transcription model. By leveraging this approach, we sought to accurately transcribe the vocal notes present in Pansori performances. The effectiveness of our attention-based segmentation methods for frame-level transcription in the source task has been compared with various algorithms using the vocal melody task of the MedleyDB dataset, enabling us to measure the voicing recall, voicing false alarm, raw pitch accuracy, raw chroma accuracy, and overall accuracy. The results of our experiments highlight the significance of attention mechanisms for enhancing the performance of frame-level music transcription models. We also conducted a visual and subjective comparison to evaluate the results of the target task for vocal note transcription. Since there was no ground truth vocal note for Pansori, this analysis provides valuable insights into the preservation and appreciation of this culturally rich art form.https://www.mdpi.com/2076-3417/14/2/492frame-level transcriptionvocal transcriptionPansori musicattention mechanismdeep learningViterbi decoding |
| spellingShingle | Bhuwan Bhattarai Joonwhoan Lee Korean Pansori Vocal Note Transcription Using Attention-Based Segmentation and Viterbi Decoding Applied Sciences frame-level transcription vocal transcription Pansori music attention mechanism deep learning Viterbi decoding |
| title | Korean Pansori Vocal Note Transcription Using Attention-Based Segmentation and Viterbi Decoding |
| title_full | Korean Pansori Vocal Note Transcription Using Attention-Based Segmentation and Viterbi Decoding |
| title_fullStr | Korean Pansori Vocal Note Transcription Using Attention-Based Segmentation and Viterbi Decoding |
| title_full_unstemmed | Korean Pansori Vocal Note Transcription Using Attention-Based Segmentation and Viterbi Decoding |
| title_short | Korean Pansori Vocal Note Transcription Using Attention-Based Segmentation and Viterbi Decoding |
| title_sort | korean pansori vocal note transcription using attention based segmentation and viterbi decoding |
| topic | frame-level transcription vocal transcription Pansori music attention mechanism deep learning Viterbi decoding |
| url | https://www.mdpi.com/2076-3417/14/2/492 |
| work_keys_str_mv | AT bhuwanbhattarai koreanpansorivocalnotetranscriptionusingattentionbasedsegmentationandviterbidecoding AT joonwhoanlee koreanpansorivocalnotetranscriptionusingattentionbasedsegmentationandviterbidecoding |