Synergy effects with mobile (audio and) video telephony

Annemiek van Drunen, Frans van der Sluis, Egon van den Broek

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademic

    29 Downloads (Pure)


    Multimodal percepts as compared to unimodal (e.g., visual, auditive) percepts contain more information and as such can advance various processes; e.g., communication. Despite, on the one hand, the vast amount of studies that illustrate this and, on the other hand, the progress in technology, (multimodal) mobile video telephony (MVT) is not used on a large scale. In a quest to explain the latter, we studied the influence of screen size on the synergy of audio and video and its influence on the illegibility of the information. The study focused on the effects of screen sizes on multimodal perception since a small screen size is a key feature of mobile phones and former research seldom examined the effects of screen size. 54 participants conducted an experiment in which the intelligibility of a standardized video-listening test was determined for three screen sizes: mobile phone, PDA and PC monitor. A signal-to-(white) noise ratio of -9dB significantly limited the intelligibility of the videos. A significant increase in intelligibility for the large compared to the small screens was found. With respect to the Quality of Service of MVT, two conclusions result: 1) the display size should be maximized and 2) already considerable amounts of noise decreases intelligibility. Consequently, we emphasize the need for both research on effects of screen size and noise on multimodal perception and technological development to develop optimal MVT.
    Original languageUndefined
    Title of host publicationDag van de Perceptie
    EditorsJ. Beintema, R. Drullman, J. van Erp
    Place of PublicationSoesterberg, Nederland
    ISBN (Print)not assigned
    Publication statusPublished - 20 Jun 2008
    EventDag van de Perceptie 2008 - Soesterberg, Nederland
    Duration: 20 Jun 200820 Jun 2008

    Publication series



    WorkshopDag van de Perceptie 2008
    Other20 June 2008


    • METIS-252710
    • IR-79498
    • Noise
    • Unimodal
    • Multimodal
    • EWI-21219
    • illegibility
    • mobile video telephony
    • Perception
    • HMI-HF: Human Factors
    • screen size

    Cite this