Section: Application Domains

Application Domains

  • Authoring and Performing Interactive Music. The combination of both realtime machine listening systems and reactive programming paradigms has enabled the authoring of interactive music systems as well as their realtime performance within a coherent synchronous framework called Antescofo . The module, developed since 2008 by the team members, has gained increasing attention within the user community worldwide with more than 30 prestigious public performances yearly. The outcomes of the proposed research will enhance the interactive and reactive aspects of this emerging paradigm as well as creating novel authoring tool for such purposes. The outcome of the ANR Project INEDIT (with LABRI and GRAME and coordinated by team leader), will further extend the use-cases of Antescofo for interactive multimedia pieces with more complex temporal structures and computational paradigms.

  • Music Post-Production. Outcomes of our recognition and alignment paradigms can improve and ease existing workflows employed by audio engineers for mixing and editing using commercial Digital Audio Workstations (DAW) in post-production. We have recently initiated collaborations with audio engineers at Ircam and Paris Superior Music Conservatory (CNSMDP) to define the framework [8] and we will continue to develop and integrate our tools into their daily workflow.

  • Realtime Music Information Retrieval We will apply our information geometric approach to well-known and complex MIR problems. A glance of such problems is presented in [5] . Such applications can be used as front-end of many high-level MIR applications such as audio summarisation, audio finger printing, and automatic annotation tools. Besides such low-level enhancements, our information geometric approach can address the well-known (and still to be solved) problem of audio queries over a database.

  • Automatic Accompaniment/Creative Tools for Entertainment Industry Technologies developed by MUTANT can find their way with general public (besides professional musicians) and within the entertainment industry. Recent trends in music industry show signs of tendencies towards more intelligent and interactive interfaces for music applications. Among them is reactive and adaptive automatic accompaniment and performance assessment as commercialized by companies such as MakeMusic and Tonara. Technologies developed around Antescofo can enhance interaction between user and the computer for such large public applications. We hope to pursue this by licensing our technologies to third-party companies.