Article by Nicolas Brochec*, Marco Fiorini*, Mikhail Malt and Gérard Assayag (* equal contribution) has been accepted for the 50th International Computer Music Conference (ICMC) in Boston, United States.
Abstract: This paper presents a significant advancement in the co- creative capabilities of Somax2 through the integration of real-time recognition of a broad range of flute Instrumen- tal Playing Techniques (IPTs). Building on the concept of interactive systems for musical co-creation, this imple- mentation enables the recognition and response to diverse IPTs, enhancing the depth of interaction during live per- formance. The approach was tested in collaboration with a professional flutist performing Cassandra’s Dream Song by Brian Ferneyhough, a piece renowned for its complex intrication of extended playing techniques. Through this experiment, the artificial agents demonstrated the ability to adapt and engage with the performer’s techniques, cre- ating a more dynamic and responsive experience. This functionality relies on a CNN-based flute IPT recognition model, which informs the agents’ real-time responses. The paper examines the broader implications of these innova- tions for music co-creation, interactive performance, and human-AI collaboration, offering new workflows for cre- ative musical systems and potential applications in com- position and live improvisation.
