Publications

Improving Choral Music Separation through Expressive Synthesized Data from Sampled Instruments

Ke Chen, Hao-Wen Dong, Yi Luo, Julian Mcauley, Taylor Berg-Kirkpatrick, Miller Puckette, Shlomo Dubnov Proceedings of the 23rd International Society for Music Information Retrieval Conference, Dec 2022, Bengaluru, India. Read full publication. Abstract: Choral music separation refers to the task of extracting tracks of voice parts (e.g., soprano, alto, tenor, and bass) from mixed audio. […]

Publications

Deep Music Information Dynamics

Shlomo Dubnov, Ke Chen, Kevin Huang Journal of Creative Music Systems, 2022, 1 Read full publication. Abstract: Generative musical models often comprise of multiple levels of structure, presuming that the process of composition moves between background to foreground, or between generating musical surface and some deeper and reduced representation that governs hidden or latent dimensions […]

Publications

Retrieval Guided Music Captioning via Multimodal Prefixes

Nikita Srivatsan, Ke Chen, Shlomo Dubnov, Taylor Berg-Kirkpatrick Thirty-Third International Joint Conference on Artificial Intelligence {IJCAI-24}, Aug 2023, Jeju, South Korea. pp.7762-7770. Read full publication. Abstract: In this paper we put forward a new approach to music captioning, the task of automatically generating natural language descriptions for songs. These descriptions are useful both for categorization […]

Publications

Variation versus bouclage. L’improvisation est-elle soluble dans l’électro ?

Marc ChemillierFranck Jedrzejewski; Carlos Lobo; Antonia Soulez. Écrire comme composer. Le rôle des diagrammes, Éditions Delatour, pp.77-90, 2021, Musique/Philosophie, 9782752104267 Read full publication. Abstract: Les interfaces visuelles des logiciels musicaux sont des diagrammes dans un sens graphique, mais ce sont aussi des diagrammes dans un sens plus conceptuel car ils déterminent une certaine manière de […]

Publications

Le langage harmonique d’Hermeto Pascoal et son apprentissage par une intelligence artificielle

By Marc Chemillier, Jean-Pierre Cholleton. Read full publication. Abstract: Le langage harmonique d’Hermeto Pascoal et son apprentissage par une intelligenceartificielle. Conversation avec Jovino Santos Neto. Jovino Santos Neto a été le pianiste du groupe d’Hermeto Pascoal de 1977 à 1992. Depuis, il estresté le dépositaire informel du patrimoine artistique de ce grand musicien brésilien. A […]

Publications

Deriving Representative Structure Over Music Corpora

By Ilana Shapiro, Ruanqianqian Huang, Zachary Novack, Cheng-I Wang, Hao-Wen Dong, Taylor Berg-Kirkpatrick, Shlomo Dubnov, Sorin Lerner. Read full publication. Abstract: Western music is an innately hierarchical system of interacting levels of structure, from fine-grained melody to high-level form. In order to analyze music compositions holistically and at multiple granularities, we propose a unified, hierarchical […]

Publications

Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Models

Read original: arXiv:2409.12346 – Published 20/09/2024 by Tornike Karchkhadze, Mohammad Rasool Izadi, Shlomo Dubnov. Abstract: Diffusion models have recently shown strong potential in both music generation and music source separation tasks. Although in early stages, a trend is emerging towards integrating these tasks into a single framework, as both involve generating musically aligned parts and can […]

Publications

Creativity and Visual Communication from Machine to Musician: Sharing a Score through a Robotic Camera

Read original. Article published by Ross Greer, Laura Fleig, Shlomo Dubnov. Abstract: This paper explores the integration of visual communication and musical interaction by implementing a robotic camera within a « Guided Harmony » musical game. We aim to examine co-creative behaviors between human musicians and robotic systems. Our research explores existing methodologies like improvisational game pieces […]

Publications

Multi-Track MusicLDM: Towards Versatile Music Generation with Latent Diffusion Model

Read original. Published by Tornike Karchkhadze, Mohammad Rasool Izadi, Ke Chen, Gerard Assayag, Shlomo Dubnov. Abstract: Diffusion models have shown promising results in cross-modal generation tasks involving audio and music, such as text-to-sound and text-to-music generation. These text-controlled music generation models typically focus on generating music by capturing global musical attributes like genre and mood. […]

Publications

Improving Generalization of Speech Separation in Real-World Scenarios: Strategies in Simulation, Optimization, and Evaluation

View original. Published by Ke Chen, Jiaqi Su, Taylor Berg-Kirkpatrick, Shlomo Dubnov, Zeyu Jin. Abstract: Achieving robust speech separation for overlapping speakers in various acoustic environments with noise and reverberation remains an open challenge. Although existing datasets are available to train separators for specific scenarios, they do not effectively generalize across diverse real-world scenarios. In […]