Beyond the Beat: Modelling Intentions in a Virtual Conductor

Mark ter Maat, Rob M. Ebbers, Dennis Reidsma, Antinus Nijholt

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    6 Citations (Scopus)


    We describe our research on designing and implementing a Virtual Conductor. That is, a virtual human (embodied agent) that acts like a human conductor in its interaction with a real, human orchestra. We reported previously on a first version that used a digital musical score to lead an orchestra. This conductor was able to conduct the beat with a certain tempo and dynamics, and to correct the tempo if necessary, using advanced audio analysis. We observed this Virtual Conductor at work during various performances for which he was invited. These performances made us aware of shortcomings. Therefore we took a closer look at the interaction between conductors and musicians in practice, both during performances and during rehearsals, and based on this study we introduced conducting gestures that display the intentions of a conductor and developed rehearsal modules. Apart from the literature on conducting we took into account videos of human conductors and interviewed human conductors. In addition we introduced principles from conversational analysis in the new design of our Virtual Conductor.
    Original languageUndefined
    Title of host publicationINTETAIN '08: Proceedings of the 2nd international conference on INtelligent TEchnologies for interactive enterTAINment
    Place of PublicationBrussels, Belgium
    Number of pages10
    ISBN (Print)978-963-9799-13-4
    Publication statusPublished - Jan 2008
    Event2nd International Conference on INtelligent TEchnologies for interactive enterTAINment, INTETAIN 2008 - Cancun, Mexico
    Duration: 8 Jan 200810 Jan 2008
    Conference number: 2

    Publication series

    NameACM Digital Library
    PublisherICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)


    Conference2nd International Conference on INtelligent TEchnologies for interactive enterTAINment, INTETAIN 2008
    Abbreviated titleINTETAIN


    • EWI-12717
    • IR-62293
    • METIS-250974

    Cite this