CCOM-HuQin: An Annotated Multimodal Chinese Fiddle Performance Dataset

HuQin (胡琴) is a family of traditional Chinese bowed string instruments. Playing techniques (PTs) embodied in various playing styles add abundant emotional coloring and aesthetic feelings to HuQin performance. The complex applied techniques make HuQin music a challenging source for fundamental MIR ta...

Full description

Bibliographic Details
Main Authors: Yu Zhang, Ziya Zhou, Xiaobing Li, Feng Yu, Maosong Sun
Format: Article
Language:English
Published: Ubiquity Press 2023-07-01
Series:Transactions of the International Society for Music Information Retrieval
Subjects:
Online Access:https://account.transactions.ismir.net/index.php/up-j-tismir/article/view/146
_version_ 1797748859025227776
author Yu Zhang
Ziya Zhou
Xiaobing Li
Feng Yu
Maosong Sun
author_facet Yu Zhang
Ziya Zhou
Xiaobing Li
Feng Yu
Maosong Sun
author_sort Yu Zhang
collection DOAJ
description HuQin (胡琴) is a family of traditional Chinese bowed string instruments. Playing techniques (PTs) embodied in various playing styles add abundant emotional coloring and aesthetic feelings to HuQin performance. The complex applied techniques make HuQin music a challenging source for fundamental MIR tasks such as pitch analysis, transcription and score-audio alignment. In this paper, we present a multimodal performance dataset of HuQin music that contains audio-visual recordings of 11,992 single PT clips and 57 annotated musical excerpts of classical pieces. We systematically describe the HuQin PT taxonomy based on musicological theory and practical use cases. Then we introduce the dataset creation methodology and highlight the annotation principles featuring PTs. We analyze the statistics in different aspects to demonstrate the variety of PTs played in HuQin subcategories and perform preliminary experiments to show the potential applications of the dataset in various MIR tasks and cross-cultural music studies. Finally, we propose future work to extend the dataset.
first_indexed 2024-03-12T16:10:55Z
format Article
id doaj.art-dc6c9d50b6b449e39b3db4f542809856
institution Directory Open Access Journal
issn 2514-3298
language English
last_indexed 2024-03-12T16:10:55Z
publishDate 2023-07-01
publisher Ubiquity Press
record_format Article
series Transactions of the International Society for Music Information Retrieval
spelling doaj.art-dc6c9d50b6b449e39b3db4f5428098562023-08-09T14:06:47ZengUbiquity PressTransactions of the International Society for Music Information Retrieval2514-32982023-07-016160–7460–7410.5334/tismir.146125CCOM-HuQin: An Annotated Multimodal Chinese Fiddle Performance DatasetYu Zhang0https://orcid.org/0000-0002-0310-3705Ziya Zhou1https://orcid.org/0000-0002-8113-9842Xiaobing Li2Feng Yu3Maosong Sun4https://orcid.org/0000-0002-6011-6115Department of AI Music and Music Information Technology, Central Conservatory of Music, BeijingDepartment of AI Music and Music Information Technology, Central Conservatory of Music, BeijingDepartment of AI Music and Music Information Technology, Central Conservatory of Music, BeijingDepartment of AI Music and Music Information Technology, Central Conservatory of Music, BeijingDepartment of AI Music and Music Information Technology, Central Conservatory of Music, Beijing; Department of Computer Science and Technology, Tsinghua University, BeijingHuQin (胡琴) is a family of traditional Chinese bowed string instruments. Playing techniques (PTs) embodied in various playing styles add abundant emotional coloring and aesthetic feelings to HuQin performance. The complex applied techniques make HuQin music a challenging source for fundamental MIR tasks such as pitch analysis, transcription and score-audio alignment. In this paper, we present a multimodal performance dataset of HuQin music that contains audio-visual recordings of 11,992 single PT clips and 57 annotated musical excerpts of classical pieces. We systematically describe the HuQin PT taxonomy based on musicological theory and practical use cases. Then we introduce the dataset creation methodology and highlight the annotation principles featuring PTs. We analyze the statistics in different aspects to demonstrate the variety of PTs played in HuQin subcategories and perform preliminary experiments to show the potential applications of the dataset in various MIR tasks and cross-cultural music studies. Finally, we propose future work to extend the dataset.https://account.transactions.ismir.net/index.php/up-j-tismir/article/view/146chinese bowed string instrumentschinese fiddleperformance datasetplaying techniquemusic transcriptionannotation
spellingShingle Yu Zhang
Ziya Zhou
Xiaobing Li
Feng Yu
Maosong Sun
CCOM-HuQin: An Annotated Multimodal Chinese Fiddle Performance Dataset
Transactions of the International Society for Music Information Retrieval
chinese bowed string instruments
chinese fiddle
performance dataset
playing technique
music transcription
annotation
title CCOM-HuQin: An Annotated Multimodal Chinese Fiddle Performance Dataset
title_full CCOM-HuQin: An Annotated Multimodal Chinese Fiddle Performance Dataset
title_fullStr CCOM-HuQin: An Annotated Multimodal Chinese Fiddle Performance Dataset
title_full_unstemmed CCOM-HuQin: An Annotated Multimodal Chinese Fiddle Performance Dataset
title_short CCOM-HuQin: An Annotated Multimodal Chinese Fiddle Performance Dataset
title_sort ccom huqin an annotated multimodal chinese fiddle performance dataset
topic chinese bowed string instruments
chinese fiddle
performance dataset
playing technique
music transcription
annotation
url https://account.transactions.ismir.net/index.php/up-j-tismir/article/view/146
work_keys_str_mv AT yuzhang ccomhuqinanannotatedmultimodalchinesefiddleperformancedataset
AT ziyazhou ccomhuqinanannotatedmultimodalchinesefiddleperformancedataset
AT xiaobingli ccomhuqinanannotatedmultimodalchinesefiddleperformancedataset
AT fengyu ccomhuqinanannotatedmultimodalchinesefiddleperformancedataset
AT maosongsun ccomhuqinanannotatedmultimodalchinesefiddleperformancedataset