Evaluating Creativity in Automatic Reactive Accompaniment of Jazz Improvisation

Music generating computer programs can support jazz musicians and students during performance and practice, for instance by providing accompaniment for solo improvisation. However, such software typically plays sequences of static precomposed snippets and does not react to the user. In that context,...

Full description

Bibliographic Details
Main Authors: Fabian Ostermann, Igor Vatolkin, Günter Rudolph
Format: Article
Language:English
Published: Ubiquity Press 2021-11-01
Series:Transactions of the International Society for Music Information Retrieval
Subjects:
Online Access:https://transactions.ismir.net/articles/90
_version_ 1819176241494753280
author Fabian Ostermann
Igor Vatolkin
Günter Rudolph
author_facet Fabian Ostermann
Igor Vatolkin
Günter Rudolph
author_sort Fabian Ostermann
collection DOAJ
description Music generating computer programs can support jazz musicians and students during performance and practice, for instance by providing accompaniment for solo improvisation. However, such software typically plays sequences of static precomposed snippets and does not react to the user. In that context, it is hardly possible to determine whether such a system has any of its own creative powers. Within the scope of a user study with 20 participants, we evaluate and compare the mobile application iReal Pro to our own system, the evolutionary automatic and reactive system called ‘EAR Drummer’ that generates drum patterns as accompaniment to jazz solo improvisation. It adapts its behaviour in real-time by heuristic rules based on music properties derived from the user’s melodies. The user-based evaluation is performed by following the standardised procedure for evaluating creative systems (SPECS). The analysis of the results is based on a Linear Mixed Effects Model to consider fixed and random effects on the survey data. The model reveals that our system outperforms iReal Pro in all of SPECS’s partial components of creativity and significantly outperforms it for 7 of those 14 components including variety, originality, emotional involvement, and social interaction. Further, it is characterised as “better” and “more interesting” in the user survey. A conflicting observation is that while 70% of the study participants tend to prefer our more “creative” system as support for stage performances, only 40% find it more suitable for practice. Further analysis addresses differences between user groups defined by their played instrument, age, and musical experience.
first_indexed 2024-12-22T21:07:38Z
format Article
id doaj.art-6bf01fa1e4654fc092f6d44c1695aceb
institution Directory Open Access Journal
issn 2514-3298
language English
last_indexed 2024-12-22T21:07:38Z
publishDate 2021-11-01
publisher Ubiquity Press
record_format Article
series Transactions of the International Society for Music Information Retrieval
spelling doaj.art-6bf01fa1e4654fc092f6d44c1695aceb2022-12-21T18:12:38ZengUbiquity PressTransactions of the International Society for Music Information Retrieval2514-32982021-11-014110.5334/tismir.9055Evaluating Creativity in Automatic Reactive Accompaniment of Jazz ImprovisationFabian Ostermann0Igor Vatolkin1Günter Rudolph2Dept. of Computer Science, TU Dortmund UniversityDept. of Computer Science, TU Dortmund UniversityDept. of Computer Science, TU Dortmund UniversityMusic generating computer programs can support jazz musicians and students during performance and practice, for instance by providing accompaniment for solo improvisation. However, such software typically plays sequences of static precomposed snippets and does not react to the user. In that context, it is hardly possible to determine whether such a system has any of its own creative powers. Within the scope of a user study with 20 participants, we evaluate and compare the mobile application iReal Pro to our own system, the evolutionary automatic and reactive system called ‘EAR Drummer’ that generates drum patterns as accompaniment to jazz solo improvisation. It adapts its behaviour in real-time by heuristic rules based on music properties derived from the user’s melodies. The user-based evaluation is performed by following the standardised procedure for evaluating creative systems (SPECS). The analysis of the results is based on a Linear Mixed Effects Model to consider fixed and random effects on the survey data. The model reveals that our system outperforms iReal Pro in all of SPECS’s partial components of creativity and significantly outperforms it for 7 of those 14 components including variety, originality, emotional involvement, and social interaction. Further, it is characterised as “better” and “more interesting” in the user survey. A conflicting observation is that while 70% of the study participants tend to prefer our more “creative” system as support for stage performances, only 40% find it more suitable for practice. Further analysis addresses differences between user groups defined by their played instrument, age, and musical experience.https://transactions.ismir.net/articles/90evolutionary music accompaniment generationdrum patternsevaluation of creative music systemslinear mixed effects modelspecs user studylearning jazz music
spellingShingle Fabian Ostermann
Igor Vatolkin
Günter Rudolph
Evaluating Creativity in Automatic Reactive Accompaniment of Jazz Improvisation
Transactions of the International Society for Music Information Retrieval
evolutionary music accompaniment generation
drum patterns
evaluation of creative music systems
linear mixed effects model
specs user study
learning jazz music
title Evaluating Creativity in Automatic Reactive Accompaniment of Jazz Improvisation
title_full Evaluating Creativity in Automatic Reactive Accompaniment of Jazz Improvisation
title_fullStr Evaluating Creativity in Automatic Reactive Accompaniment of Jazz Improvisation
title_full_unstemmed Evaluating Creativity in Automatic Reactive Accompaniment of Jazz Improvisation
title_short Evaluating Creativity in Automatic Reactive Accompaniment of Jazz Improvisation
title_sort evaluating creativity in automatic reactive accompaniment of jazz improvisation
topic evolutionary music accompaniment generation
drum patterns
evaluation of creative music systems
linear mixed effects model
specs user study
learning jazz music
url https://transactions.ismir.net/articles/90
work_keys_str_mv AT fabianostermann evaluatingcreativityinautomaticreactiveaccompanimentofjazzimprovisation
AT igorvatolkin evaluatingcreativityinautomaticreactiveaccompanimentofjazzimprovisation
AT gunterrudolph evaluatingcreativityinautomaticreactiveaccompanimentofjazzimprovisation