{"id":2822,"date":"2025-06-18T13:49:36","date_gmt":"2025-06-18T11:49:36","guid":{"rendered":"https:\/\/reach.ircam.fr\/?p=2822"},"modified":"2025-06-18T13:55:38","modified_gmt":"2025-06-18T11:55:38","slug":"interactive-music-co-creation-with-an-instrumental-technique-aware-system-a-case-study-with-flute-and-somax2","status":"publish","type":"post","link":"https:\/\/reach.ircam.fr\/index.php\/2025\/06\/18\/interactive-music-co-creation-with-an-instrumental-technique-aware-system-a-case-study-with-flute-and-somax2\/","title":{"rendered":"Interactive Music Co-Creation with an Instrumental Technique-Aware System: A Case Study with Flute and Somax2"},"content":{"rendered":"\n<p>Article by <strong>Nicolas Brochec<\/strong>*, <strong>Marco Fiorini<\/strong>*, <strong>Mikhail Malt<\/strong> and <strong>G\u00e9rard Assayag<\/strong> (* equal contribution) has been accepted for the <a href=\"https:\/\/icmc2025.sites.northeastern.edu\" title=\"\"><strong>50th International Computer Music Conference<\/strong> <strong>(ICMC)<\/strong><\/a> in <strong>Boston<\/strong>, United States.<\/p>\n\n\n\n<p><a href=\"https:\/\/hal.science\/hal-05061669v1\/document\" title=\"\">Read the full paper<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/youtu.be\/OzNZkECfB7c\" title=\"\">Video demo<\/a><\/p>\n\n\n\n<p><strong>Abstract<\/strong>: This paper presents a significant advancement in the co- creative capabilities of Somax2 through the integration of real-time recognition of a broad range of flute Instrumen- tal Playing Techniques (IPTs). Building on the concept of interactive systems for musical co-creation, this imple- mentation enables the recognition and response to diverse IPTs, enhancing the depth of interaction during live per- formance. The approach was tested in collaboration with a professional flutist performing Cassandra\u2019s Dream Song by Brian Ferneyhough, a piece renowned for its complex intrication of extended playing techniques. Through this experiment, the artificial agents demonstrated the ability to adapt and engage with the performer\u2019s techniques, cre- ating a more dynamic and responsive experience. This functionality relies on a CNN-based flute IPT recognition model, which informs the agents\u2019 real-time responses. The paper examines the broader implications of these innova- tions for music co-creation, interactive performance, and human-AI collaboration, offering new workflows for cre- ative musical systems and potential applications in com- position and live improvisation.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Article by Nicolas Brochec*, Marco Fiorini*, Mikhail Malt and G\u00e9rard Assayag (* equal contribution) has been accepted for the 50th International Computer Music Conference (ICMC) in Boston, United States. Read the full paper Video demo Abstract: This paper presents a significant advancement in the co- creative capabilities of Somax2 through the integration of real-time recognition [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":2825,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[52,46,42],"tags":[],"class_list":["post-2822","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-conferences","category-publications-research","category-research"],"aioseo_notices":[],"blog_post_layout_featured_media_urls":{"thumbnail":["https:\/\/reach.ircam.fr\/wp-content\/uploads\/2025\/06\/Screenshot-2025-06-18-at-13.50.11-150x150.png",150,150,true],"full":["https:\/\/reach.ircam.fr\/wp-content\/uploads\/2025\/06\/Screenshot-2025-06-18-at-13.50.11.png",1574,686,false]},"categories_names":{"52":{"name":"Conferences","link":"https:\/\/reach.ircam.fr\/index.php\/category\/research\/conferences\/"},"46":{"name":"Publications","link":"https:\/\/reach.ircam.fr\/index.php\/category\/research\/publications-research\/"},"42":{"name":"Research","link":"https:\/\/reach.ircam.fr\/index.php\/category\/research\/"}},"tags_names":[],"comments_number":"0","wpmagazine_modules_lite_featured_media_urls":{"thumbnail":["https:\/\/reach.ircam.fr\/wp-content\/uploads\/2025\/06\/Screenshot-2025-06-18-at-13.50.11-150x150.png",150,150,true],"cvmm-medium":["https:\/\/reach.ircam.fr\/wp-content\/uploads\/2025\/06\/Screenshot-2025-06-18-at-13.50.11-300x300.png",300,300,true],"cvmm-medium-plus":["https:\/\/reach.ircam.fr\/wp-content\/uploads\/2025\/06\/Screenshot-2025-06-18-at-13.50.11-305x207.png",305,207,true],"cvmm-portrait":["https:\/\/reach.ircam.fr\/wp-content\/uploads\/2025\/06\/Screenshot-2025-06-18-at-13.50.11-400x600.png",400,600,true],"cvmm-medium-square":["https:\/\/reach.ircam.fr\/wp-content\/uploads\/2025\/06\/Screenshot-2025-06-18-at-13.50.11-600x600.png",600,600,true],"cvmm-large":["https:\/\/reach.ircam.fr\/wp-content\/uploads\/2025\/06\/Screenshot-2025-06-18-at-13.50.11-1024x686.png",1024,686,true],"cvmm-small":["https:\/\/reach.ircam.fr\/wp-content\/uploads\/2025\/06\/Screenshot-2025-06-18-at-13.50.11-130x95.png",130,95,true],"full":["https:\/\/reach.ircam.fr\/wp-content\/uploads\/2025\/06\/Screenshot-2025-06-18-at-13.50.11.png",1574,686,false]},"_links":{"self":[{"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/posts\/2822","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/comments?post=2822"}],"version-history":[{"count":4,"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/posts\/2822\/revisions"}],"predecessor-version":[{"id":2830,"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/posts\/2822\/revisions\/2830"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/media\/2825"}],"wp:attachment":[{"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/media?parent=2822"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/categories?post=2822"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/reach.ircam.fr\/index.php\/wp-json\/wp\/v2\/tags?post=2822"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}