A query-based framework to handle data issues in concatenative sound synthesis
Concatenative Sound Synthesis (CSS) is a data-driven method to synthesise new sounds. It involves taking in a sound, decomposing it into smaller sound segments, analyzing its spectral and other auditory content, before searching into a database of other sound segments for a matching pair. The select...
| Main Authors: | , |
|---|---|
| Format: | Conference or Workshop Item |
| Language: | English |
| Published: |
2014
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/38837/1/38837.pdf |
| _version_ | 1796973421777649664 |
|---|---|
| author | Mohd. Norowi, Noris Miranda, Eduardo Reck |
| author_facet | Mohd. Norowi, Noris Miranda, Eduardo Reck |
| author_sort | Mohd. Norowi, Noris |
| collection | UPM |
| description | Concatenative Sound Synthesis (CSS) is a data-driven method to synthesise new sounds. It involves taking in a sound, decomposing it into smaller sound segments, analyzing its spectral and other auditory content, before searching into a database of other sound segments for a matching pair. The selected segments are then concatenated together in sequence, and are then resynthesised to produce new sounds that are based on the original. However, with the increase in processing power, hard disk capacity and network bandwidth, the amount of audio information that is possible be extracted from each of the sound segments can become too much, rendering it useless in aiding the matching process. This study looks at the current approaches adopted in matching sound segment in CSS and discusses the challenges which arise from it. This includes the tradeoffs of extracting huge, multi-dimensional audio features and the need to understand human sound perception in order to minimize the synthesis of mismatching segments. To improve similarity result, a query-based CSS framework is proposed. A proof-of-concept, ConQuer, was also developed based on this framework, which offers users parametric control in order to communicate their intended creations to the system to synthesise. |
| first_indexed | 2024-03-06T08:42:25Z |
| format | Conference or Workshop Item |
| id | upm.eprints-38837 |
| institution | Universiti Putra Malaysia |
| language | English |
| last_indexed | 2024-03-06T08:42:25Z |
| publishDate | 2014 |
| record_format | dspace |
| spelling | upm.eprints-388372016-07-29T08:12:20Z http://psasir.upm.edu.my/id/eprint/38837/ A query-based framework to handle data issues in concatenative sound synthesis Mohd. Norowi, Noris Miranda, Eduardo Reck Concatenative Sound Synthesis (CSS) is a data-driven method to synthesise new sounds. It involves taking in a sound, decomposing it into smaller sound segments, analyzing its spectral and other auditory content, before searching into a database of other sound segments for a matching pair. The selected segments are then concatenated together in sequence, and are then resynthesised to produce new sounds that are based on the original. However, with the increase in processing power, hard disk capacity and network bandwidth, the amount of audio information that is possible be extracted from each of the sound segments can become too much, rendering it useless in aiding the matching process. This study looks at the current approaches adopted in matching sound segment in CSS and discusses the challenges which arise from it. This includes the tradeoffs of extracting huge, multi-dimensional audio features and the need to understand human sound perception in order to minimize the synthesis of mismatching segments. To improve similarity result, a query-based CSS framework is proposed. A proof-of-concept, ConQuer, was also developed based on this framework, which offers users parametric control in order to communicate their intended creations to the system to synthesise. 2014 Conference or Workshop Item NonPeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/38837/1/38837.pdf Mohd. Norowi, Noris and Miranda, Eduardo Reck (2014) A query-based framework to handle data issues in concatenative sound synthesis. In: Malaysian National Conference of Databases 2014 (MaNCoD 2014), 17 Sept. 2014, Universiti Putra Malaysia, Serdang, Selangor. (pp. 81-86). (Unpublished) http://mancod2014.blogspot.my/p/proceedings.html |
| spellingShingle | Mohd. Norowi, Noris Miranda, Eduardo Reck A query-based framework to handle data issues in concatenative sound synthesis |
| title | A query-based framework to handle data issues in concatenative sound synthesis |
| title_full | A query-based framework to handle data issues in concatenative sound synthesis |
| title_fullStr | A query-based framework to handle data issues in concatenative sound synthesis |
| title_full_unstemmed | A query-based framework to handle data issues in concatenative sound synthesis |
| title_short | A query-based framework to handle data issues in concatenative sound synthesis |
| title_sort | query based framework to handle data issues in concatenative sound synthesis |
| url | http://psasir.upm.edu.my/id/eprint/38837/1/38837.pdf |
| work_keys_str_mv | AT mohdnorowinoris aquerybasedframeworktohandledataissuesinconcatenativesoundsynthesis AT mirandaeduardoreck aquerybasedframeworktohandledataissuesinconcatenativesoundsynthesis AT mohdnorowinoris querybasedframeworktohandledataissuesinconcatenativesoundsynthesis AT mirandaeduardoreck querybasedframeworktohandledataissuesinconcatenativesoundsynthesis |