Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes

R.P.H. Vertegaal; R. Slagter; Gerrit C. van der Veer; Antinus Nijholt

doi:10.1145/365024.365119

Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes

R.P.H. Vertegaal, R. Slagter, Gerrit C. van der Veer, Antinus Nijholt

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Professional

312 Citations (Scopus)

71 Downloads (Pure)

Abstract

In multi-agent, multi-user environments, users as well as agents should have a means of establishing who is talking to whom. In this paper, we present an experiment aimed at evaluating whether gaze directional cues of users could be used for this purpose. Using an eye tracker, we measured subject gaze at the faces of conversational partners during four-person conversations. Results indicate that when someone is listening or speaking to individuals, there is indeed a high probability that the person looked at is the person listened (p=88%) or spoken to (p=77%). We conclude that gaze is an excellent predictor of conversational attention in multiparty conversations. As such, it may form a reliable source of input for conversational systems that need to establish whom the user is speaking or listening to. We implemented our findings in FRED, a multi-agent conversational system that uses eye input to gauge which agent the user is listening or speaking to.

Original language	English
Title of host publication	CHI 2001: Anyone, Anywhere
Subtitle of host publication	CHI 2001 conference proceedings
Editors	J. Jacko, A. Sears, M. Beaudouin-Lafon, R.J.K. Jacob
Place of Publication	New York, NY
Publisher	ACM Press
Pages	301-308
Number of pages	8
ISBN (Print)	9781581133271
DOIs	https://doi.org/10.1145/365024.365119
Publication status	Published - 31 Mar 2001
Event	2001 SIGCHI Conference on Human Factors in Computing Systems, CHI 2001: Anyone, Anywhere - Seattle, United States Duration: 31 Mar 2001 → 5 Apr 2001

Conference

Conference	2001 SIGCHI Conference on Human Factors in Computing Systems, CHI 2001
Abbreviated title	CHI
Country/Territory	United States
City	Seattle
Period	31/03/01 → 5/04/01

Keywords

HMI-MI: MULTIMODAL INTERACTIONS

Access to Document

10.1145/365024.365119

Cite this

@inproceedings{0f2bd649795f43609a8abfe86acb1cb8,

title = "Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes",

abstract = "In multi-agent, multi-user environments, users as well as agents should have a means of establishing who is talking to whom. In this paper, we present an experiment aimed at evaluating whether gaze directional cues of users could be used for this purpose. Using an eye tracker, we measured subject gaze at the faces of conversational partners during four-person conversations. Results indicate that when someone is listening or speaking to individuals, there is indeed a high probability that the person looked at is the person listened (p=88%) or spoken to (p=77%). We conclude that gaze is an excellent predictor of conversational attention in multiparty conversations. As such, it may form a reliable source of input for conversational systems that need to establish whom the user is speaking or listening to. We implemented our findings in FRED, a multi-agent conversational system that uses eye input to gauge which agent the user is listening or speaking to.",

keywords = "HMI-MI: MULTIMODAL INTERACTIONS",

author = "R.P.H. Vertegaal and R. Slagter and {van der Veer}, {Gerrit C.} and Antinus Nijholt",

year = "2001",

month = mar,

day = "31",

doi = "10.1145/365024.365119",

language = "English",

isbn = "9781581133271",

pages = "301--308",

editor = "J. Jacko and A. Sears and M. Beaudouin-Lafon and R.J.K. Jacob",

booktitle = "CHI 2001: Anyone, Anywhere",

publisher = "ACM Press",

note = "2001 SIGCHI Conference on Human Factors in Computing Systems, CHI 2001 : Anyone, Anywhere, CHI ; Conference date: 31-03-2001 Through 05-04-2001",

}

Vertegaal, RPH, Slagter, R, van der Veer, GC & Nijholt, A 2001, Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes. in J Jacko, A Sears, M Beaudouin-Lafon & RJK Jacob (eds), CHI 2001: Anyone, Anywhere: CHI 2001 conference proceedings. ACM Press, New York, NY, pp. 301-308, 2001 SIGCHI Conference on Human Factors in Computing Systems, CHI 2001, Seattle, Washington, United States, 31/03/01. https://doi.org/10.1145/365024.365119

Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes. / Vertegaal, R.P.H.; Slagter, R.; van der Veer, Gerrit C. et al.
CHI 2001: Anyone, Anywhere: CHI 2001 conference proceedings. ed. / J. Jacko; A. Sears; M. Beaudouin-Lafon; R.J.K. Jacob. New York, NY: ACM Press, 2001. p. 301-308.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Professional

TY - GEN

T1 - Eye Gaze Patterns in Conversations

T2 - 2001 SIGCHI Conference on Human Factors in Computing Systems, CHI 2001

AU - Vertegaal, R.P.H.

AU - Slagter, R.

AU - van der Veer, Gerrit C.

AU - Nijholt, Antinus

PY - 2001/3/31

Y1 - 2001/3/31

N2 - In multi-agent, multi-user environments, users as well as agents should have a means of establishing who is talking to whom. In this paper, we present an experiment aimed at evaluating whether gaze directional cues of users could be used for this purpose. Using an eye tracker, we measured subject gaze at the faces of conversational partners during four-person conversations. Results indicate that when someone is listening or speaking to individuals, there is indeed a high probability that the person looked at is the person listened (p=88%) or spoken to (p=77%). We conclude that gaze is an excellent predictor of conversational attention in multiparty conversations. As such, it may form a reliable source of input for conversational systems that need to establish whom the user is speaking or listening to. We implemented our findings in FRED, a multi-agent conversational system that uses eye input to gauge which agent the user is listening or speaking to.

AB - In multi-agent, multi-user environments, users as well as agents should have a means of establishing who is talking to whom. In this paper, we present an experiment aimed at evaluating whether gaze directional cues of users could be used for this purpose. Using an eye tracker, we measured subject gaze at the faces of conversational partners during four-person conversations. Results indicate that when someone is listening or speaking to individuals, there is indeed a high probability that the person looked at is the person listened (p=88%) or spoken to (p=77%). We conclude that gaze is an excellent predictor of conversational attention in multiparty conversations. As such, it may form a reliable source of input for conversational systems that need to establish whom the user is speaking or listening to. We implemented our findings in FRED, a multi-agent conversational system that uses eye input to gauge which agent the user is listening or speaking to.

KW - HMI-MI: MULTIMODAL INTERACTIONS

U2 - 10.1145/365024.365119

DO - 10.1145/365024.365119

M3 - Conference contribution

SN - 9781581133271

SP - 301

EP - 308

BT - CHI 2001: Anyone, Anywhere

A2 - Jacko, J.

A2 - Sears, A.

A2 - Beaudouin-Lafon, M.

A2 - Jacob, R.J.K.

PB - ACM Press

CY - New York, NY

Y2 - 31 March 2001 through 5 April 2001

ER -

Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this