Temporal Interaction between an Artificial Orchestra Conductor and Human Musicians

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    53 Downloads (Pure)

    Abstract

    One interest of our research group is in (1) developing Ambient Entertainment technologies and applications that (2) interact in a coordinated way with human partners using (3) a multitude of different sensors observing many characteristics of the partner and using (4) many different channels of expression (such as sound, visuals, speech and embodiment with gestures and facial expressions). The Virtual Conductor project [1, 2] concerns the development of the first properly interactive virtual orchestra conductor that can conduct a piece of music through interaction with musicians, leading and following them while they are playing. Its observations consist of different manners of musical processing of the incoming signal from a microphone. The forms of its expressions are defined by the possible conducting patterns and by the timing, speed, amplitude and smoothness with which those patterns are expressed. The interaction is focused on the tempo of the musicians and includes a correction module that interactively corrects the tempo when the musicians are playing too slow or too fast.
    We describe our motivation for developing such a system; related work in the areas of ambient entertainment and coordinated timing, automatic music processing, virtual humans and conducting; the design, implementation and evaluation of the Virtual Conductor; and, finally, contains a discussion of the resulting system, general applicability of the ideas and technology developed in this project, and expected developments in the (ongoing) Virtual Conductor project.
    Original languageEnglish
    Title of host publicationBNAIC 2008
    Subtitle of host publicationProceedings of BNAIC 2008, the twentieth Belgian-Dutch Artificial Intelligence Conference, Enschede/Bad Boekelo, October 30-31, 2008
    EditorsAnton Nijholt, Maja Pantic, Mannes Poel, Hendri Hondorp
    Place of PublicationEnschede, the Netherlands
    PublisherUniversity of Twente
    Pages405-406
    Number of pages2
    Publication statusPublished - 15 Oct 2008
    Event20th Benelux Conference on Artificial Intelligence, BNAIC 2008 - Boekelo, Netherlands
    Duration: 30 Oct 200831 Oct 2008
    Conference number: 20

    Publication series

    NameBNAIC: proceedings of the ... Belgium/Netherlands Artificial Intelligence Conference
    PublisherUniversity of Twente
    Number20
    ISSN (Print)1568-7805

    Conference

    Conference20th Benelux Conference on Artificial Intelligence, BNAIC 2008
    Abbreviated titleBNAIC
    CountryNetherlands
    CityBoekelo
    Period30/10/0831/10/08

    Keywords

    • EWI-13532
    • IR-65015
    • METIS-251207
    • HMI-MI: MULTIMODAL INTERACTIONS

    Fingerprint Dive into the research topics of 'Temporal Interaction between an Artificial Orchestra Conductor and Human Musicians'. Together they form a unique fingerprint.

  • Cite this

    Reidsma, D., Nijholt, A., & Bos, P. (2008). Temporal Interaction between an Artificial Orchestra Conductor and Human Musicians. In A. Nijholt, M. Pantic, M. Poel, & H. Hondorp (Eds.), BNAIC 2008: Proceedings of BNAIC 2008, the twentieth Belgian-Dutch Artificial Intelligence Conference, Enschede/Bad Boekelo, October 30-31, 2008 (pp. 405-406). (BNAIC: proceedings of the ... Belgium/Netherlands Artificial Intelligence Conference; No. 20). Enschede, the Netherlands: University of Twente.