The recognition of acted interpersonal stance in police interrogations and the influence of actor proficiency

Merijn Bruijnes, Hendrikus J.A. op den Akker, Sophie Spitters, Merijn Sanders, Quihua Fu

Abstract

This paper reports on judgement studies regarding the perception of interpersonal stances taken by humans playing the role of a suspect in a police interrogation setting. Our project aims at building believable embodied conversational characters to play the role of suspects in a serious game for learning interrogation strategies. The main question we ask is: do human judges agree on the way they perceive the various aspects of stance taking, such as friendliness and dominance? Four types of stances were acted by eight amateur actors. Short recordings were shown in an online survey to subjects who were asked to describe them using a selection of a number of adjectives. Results of this annotation task are reported in this paper. We explain how we computed the inter-rater agreement with Krippendorff’s alpha statistics using a set theoretical distance metric. Results show that for some of the stance types observers agreed more than for others. Some actors are better than others, but validity (recognizing the intended stance) and inter-rater agreement do not always go hand in hand. We further investigate the effect the expertise of actors has on the perception of the stance that is acted. We compare the fragments from amateur actors to fragments from professional actors taken from popular TV-shows.
Original languageUndefined
Pages (from-to)353-376
Number of pages24
JournalJournal on multimodal user interfaces
Volume9
Issue number4
DOIs
StatePublished - Dec 2015

Fingerprint

Law enforcement
Statistics

Keywords

  • EWI-26159
  • HMI-MI: MULTIMODAL INTERACTIONS
  • Body language
  • Affect expression
  • IR-98111
  • Interpersonal stance
  • Embodied Conversational Agents
  • METIS-314923
  • Data reliability

Cite this

Bruijnes, Merijn; op den Akker, Hendrikus J.A.; Spitters, Sophie; Sanders, Merijn; Fu, Quihua / The recognition of acted interpersonal stance in police interrogations and the influence of actor proficiency.

In: Journal on multimodal user interfaces, Vol. 9, No. 4, 12.2015, p. 353-376.

Research output: Scientific - peer-reviewArticle

@article{7f7d8f7d693541b8a1700307b7d7cb6b,
title = "The recognition of acted interpersonal stance in police interrogations and the influence of actor proficiency",
abstract = "This paper reports on judgement studies regarding the perception of interpersonal stances taken by humans playing the role of a suspect in a police interrogation setting. Our project aims at building believable embodied conversational characters to play the role of suspects in a serious game for learning interrogation strategies. The main question we ask is: do human judges agree on the way they perceive the various aspects of stance taking, such as friendliness and dominance? Four types of stances were acted by eight amateur actors. Short recordings were shown in an online survey to subjects who were asked to describe them using a selection of a number of adjectives. Results of this annotation task are reported in this paper. We explain how we computed the inter-rater agreement with Krippendorff’s alpha statistics using a set theoretical distance metric. Results show that for some of the stance types observers agreed more than for others. Some actors are better than others, but validity (recognizing the intended stance) and inter-rater agreement do not always go hand in hand. We further investigate the effect the expertise of actors has on the perception of the stance that is acted. We compare the fragments from amateur actors to fragments from professional actors taken from popular TV-shows.",
keywords = "EWI-26159, HMI-MI: MULTIMODAL INTERACTIONS, Body language, Affect expression, IR-98111, Interpersonal stance, Embodied Conversational Agents, METIS-314923, Data reliability",
author = "Merijn Bruijnes and {op den Akker}, {Hendrikus J.A.} and Sophie Spitters and Merijn Sanders and Quihua Fu",
note = "Invited paper",
year = "2015",
month = "12",
doi = "10.1007/s12193-015-0189-0",
volume = "9",
pages = "353--376",
journal = "Journal on multimodal user interfaces",
issn = "1783-7677",
publisher = "Springer Verlag",
number = "4",

}

The recognition of acted interpersonal stance in police interrogations and the influence of actor proficiency. / Bruijnes, Merijn; op den Akker, Hendrikus J.A.; Spitters, Sophie; Sanders, Merijn; Fu, Quihua.

In: Journal on multimodal user interfaces, Vol. 9, No. 4, 12.2015, p. 353-376.

Research output: Scientific - peer-reviewArticle

TY - JOUR

T1 - The recognition of acted interpersonal stance in police interrogations and the influence of actor proficiency

AU - Bruijnes,Merijn

AU - op den Akker,Hendrikus J.A.

AU - Spitters,Sophie

AU - Sanders,Merijn

AU - Fu,Quihua

N1 - Invited paper

PY - 2015/12

Y1 - 2015/12

N2 - This paper reports on judgement studies regarding the perception of interpersonal stances taken by humans playing the role of a suspect in a police interrogation setting. Our project aims at building believable embodied conversational characters to play the role of suspects in a serious game for learning interrogation strategies. The main question we ask is: do human judges agree on the way they perceive the various aspects of stance taking, such as friendliness and dominance? Four types of stances were acted by eight amateur actors. Short recordings were shown in an online survey to subjects who were asked to describe them using a selection of a number of adjectives. Results of this annotation task are reported in this paper. We explain how we computed the inter-rater agreement with Krippendorff’s alpha statistics using a set theoretical distance metric. Results show that for some of the stance types observers agreed more than for others. Some actors are better than others, but validity (recognizing the intended stance) and inter-rater agreement do not always go hand in hand. We further investigate the effect the expertise of actors has on the perception of the stance that is acted. We compare the fragments from amateur actors to fragments from professional actors taken from popular TV-shows.

AB - This paper reports on judgement studies regarding the perception of interpersonal stances taken by humans playing the role of a suspect in a police interrogation setting. Our project aims at building believable embodied conversational characters to play the role of suspects in a serious game for learning interrogation strategies. The main question we ask is: do human judges agree on the way they perceive the various aspects of stance taking, such as friendliness and dominance? Four types of stances were acted by eight amateur actors. Short recordings were shown in an online survey to subjects who were asked to describe them using a selection of a number of adjectives. Results of this annotation task are reported in this paper. We explain how we computed the inter-rater agreement with Krippendorff’s alpha statistics using a set theoretical distance metric. Results show that for some of the stance types observers agreed more than for others. Some actors are better than others, but validity (recognizing the intended stance) and inter-rater agreement do not always go hand in hand. We further investigate the effect the expertise of actors has on the perception of the stance that is acted. We compare the fragments from amateur actors to fragments from professional actors taken from popular TV-shows.

KW - EWI-26159

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - Body language

KW - Affect expression

KW - IR-98111

KW - Interpersonal stance

KW - Embodied Conversational Agents

KW - METIS-314923

KW - Data reliability

U2 - 10.1007/s12193-015-0189-0

DO - 10.1007/s12193-015-0189-0

M3 - Article

VL - 9

SP - 353

EP - 376

JO - Journal on multimodal user interfaces

T2 - Journal on multimodal user interfaces

JF - Journal on multimodal user interfaces

SN - 1783-7677

IS - 4

ER -