Supporting Engagement and Floor Control in Hybrid Meetings

Hendrikus J.A. op den Akker; D.H.W. Hofs; G.H.W. Hondorp; Harm op den Akker; Jakob Zwiers; Antinus Nijholt

doi:10.1007/978-3-642-03320-9_26

Supporting Engagement and Floor Control in Hybrid Meetings

Hendrikus J.A. op den Akker, D.H.W. Hofs, G.H.W. Hondorp, Harm op den Akker, Jakob Zwiers, Antinus Nijholt

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

10 Citations (Scopus)

Abstract

Remote participants in hybrid meetings often have problems to follow what is going on in the (physical) meeting room they are connected with. This paper describes a videoconferencing system for participation in hybrid meetings. The system has been developed as a research vehicle to see how technology based on automatic real-time recognition of conversational behavior in meetings can be used to improve engagement and floor control by remote participants. The system uses modules for online speech recognition, real-time visual focus of attention as well as a module that signals who is being addressed by the speaker. A built-in keyword spotter allows an automatic meeting assistant to call the remote participant’s attention when a topic of interest is raised, pointing at the transcription of the fragment to help him catch-up.

Original language	Undefined
Title of host publication	Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions
Editors	Anna Esposito, Robert Vich
Place of Publication	Berlin
Publisher	Springer
Pages	276-290
Number of pages	15
ISBN (Print)	978-3-642-03319-3
DOIs	https://doi.org/10.1007/978-3-642-03320-9_26
Publication status	Published - 14 Jul 2009

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer Verlag
Volume	5641
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Keywords

HMI-MI: MULTIMODAL INTERACTIONS
EC Grant Agreement nr.: FP6/0033812
METIS-265736
IR-67693
EWI-14716

Access to Document

10.1007/978-3-642-03320-9_26

http://eprints.eemcs.utwente.nl/secure2/14716/01/cost_prague2009.pdf

Cite this

op den Akker, H. J. A., Hofs, D. H. W., Hondorp, G. H. W., op den Akker, H., Zwiers, J., & Nijholt, A. (2009). Supporting Engagement and Floor Control in Hybrid Meetings. In A. Esposito, & R. Vich (Eds.), Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions (pp. 276-290). [10.1007/978-3-642-03320-9_26] (Lecture Notes in Computer Science; Vol. 5641). Springer. https://doi.org/10.1007/978-3-642-03320-9_26

@inproceedings{5af4b25842f046ae9cb20404a628972f,

title = "Supporting Engagement and Floor Control in Hybrid Meetings",

abstract = "Remote participants in hybrid meetings often have problems to follow what is going on in the (physical) meeting room they are connected with. This paper describes a videoconferencing system for participation in hybrid meetings. The system has been developed as a research vehicle to see how technology based on automatic real-time recognition of conversational behavior in meetings can be used to improve engagement and floor control by remote participants. The system uses modules for online speech recognition, real-time visual focus of attention as well as a module that signals who is being addressed by the speaker. A built-in keyword spotter allows an automatic meeting assistant to call the remote participant{\textquoteright}s attention when a topic of interest is raised, pointing at the transcription of the fragment to help him catch-up.",

keywords = "HMI-MI: MULTIMODAL INTERACTIONS, EC Grant Agreement nr.: FP6/0033812, METIS-265736, IR-67693, EWI-14716",

author = "{op den Akker}, {Hendrikus J.A.} and D.H.W. Hofs and G.H.W. Hondorp and {op den Akker}, Harm and Jakob Zwiers and Antinus Nijholt",

note = "10.1007/978-3-642-03320-9_26 ",

year = "2009",

month = jul,

day = "14",

doi = "10.1007/978-3-642-03320-9_26",

language = "Undefined",

isbn = "978-3-642-03319-3",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "276--290",

editor = "Anna Esposito and Robert Vich",

booktitle = "Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions",

}

op den Akker, HJA, Hofs, DHW, Hondorp, GHW , op den Akker, H , Zwiers, J & Nijholt, A 2009, Supporting Engagement and Floor Control in Hybrid Meetings. in A Esposito & R Vich (eds), Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions., 10.1007/978-3-642-03320-9_26, Lecture Notes in Computer Science, vol. 5641, Springer, Berlin, pp. 276-290. https://doi.org/10.1007/978-3-642-03320-9_26

Supporting Engagement and Floor Control in Hybrid Meetings. / op den Akker, Hendrikus J.A.; Hofs, D.H.W.; Hondorp, G.H.W.; op den Akker, Harm ; Zwiers, Jakob ; Nijholt, Antinus.

Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions. ed. / Anna Esposito; Robert Vich. Berlin : Springer, 2009. p. 276-290 10.1007/978-3-642-03320-9_26 (Lecture Notes in Computer Science; Vol. 5641).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Supporting Engagement and Floor Control in Hybrid Meetings

AU - op den Akker, Hendrikus J.A.

AU - Hofs, D.H.W.

AU - Hondorp, G.H.W.

AU - op den Akker, Harm

AU - Zwiers, Jakob

AU - Nijholt, Antinus

N1 - 10.1007/978-3-642-03320-9_26

PY - 2009/7/14

Y1 - 2009/7/14

N2 - Remote participants in hybrid meetings often have problems to follow what is going on in the (physical) meeting room they are connected with. This paper describes a videoconferencing system for participation in hybrid meetings. The system has been developed as a research vehicle to see how technology based on automatic real-time recognition of conversational behavior in meetings can be used to improve engagement and floor control by remote participants. The system uses modules for online speech recognition, real-time visual focus of attention as well as a module that signals who is being addressed by the speaker. A built-in keyword spotter allows an automatic meeting assistant to call the remote participant’s attention when a topic of interest is raised, pointing at the transcription of the fragment to help him catch-up.

AB - Remote participants in hybrid meetings often have problems to follow what is going on in the (physical) meeting room they are connected with. This paper describes a videoconferencing system for participation in hybrid meetings. The system has been developed as a research vehicle to see how technology based on automatic real-time recognition of conversational behavior in meetings can be used to improve engagement and floor control by remote participants. The system uses modules for online speech recognition, real-time visual focus of attention as well as a module that signals who is being addressed by the speaker. A built-in keyword spotter allows an automatic meeting assistant to call the remote participant’s attention when a topic of interest is raised, pointing at the transcription of the fragment to help him catch-up.

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - EC Grant Agreement nr.: FP6/0033812

KW - METIS-265736

KW - IR-67693

KW - EWI-14716

U2 - 10.1007/978-3-642-03320-9_26

DO - 10.1007/978-3-642-03320-9_26

M3 - Conference contribution

SN - 978-3-642-03319-3

T3 - Lecture Notes in Computer Science

SP - 276

EP - 290

BT - Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions

A2 - Esposito, Anna

A2 - Vich, Robert

PB - Springer

CY - Berlin

ER -

op den Akker HJA, Hofs DHW, Hondorp GHW , op den Akker H , Zwiers J , Nijholt A. Supporting Engagement and Floor Control in Hybrid Meetings. In Esposito A, Vich R, editors, Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions. Berlin: Springer. 2009. p. 276-290. 10.1007/978-3-642-03320-9_26. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-642-03320-9_26