Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the use of digital tools

Arjan Van Hessen; Silvia Calamai; Henk Van Den Heuvel; Stefania Scagliola; Norah Karrouche; Jeannine Beeken; Louise Corti; Christoph Draxler

doi:10.1145/3382507.3420054

Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the use of digital tools

Arjan Van Hessen, Silvia Calamai, Henk Van Den Heuvel, Stefania Scagliola, Norah Karrouche, Jeannine Beeken, Louise Corti, Christoph Draxler

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

1 Citation (Scopus)

73 Downloads (Pure)

Abstract

Interview data is multimodal data: it consists of speech sound, facial expression and gestures, captured in a particular situation, and containing textual information and emotion. This workshop shows how a multidisciplinary approach may exploit the full potential of interview data. The workshop first gives a systematic overview of the research fields working with interview data. It then presents the speech technology currently available to support transcribing and annotating interview data, such as automatic speech recognition, speaker diarization, and emotion detection. Finally, scholars who work with interview data and tools may present their work and discover how to make use of existing technology.

Original language	English
Title of host publication	ICMI '20
Subtitle of host publication	Proceedings of the 2020 International Conference on Multimodal Interaction
Place of Publication	New York, NY
Publisher	Association for Computing Machinery
Pages	886-887
Number of pages	2
ISBN (Electronic)	978-1-4503-7581-8
DOIs	https://doi.org/10.1145/3382507.3420054
Publication status	Published - 22 Oct 2020
Event	22nd ACM International Conference on Multimodal Interaction, ICMI 2020 - Online, Virtual, Online, Netherlands Duration: 25 Oct 2020 → 29 Oct 2020 Conference number: 22 http://icmi.acm.org/2020/

Conference

Conference	22nd ACM International Conference on Multimodal Interaction, ICMI 2020
Abbreviated title	ICMI
Country/Territory	Netherlands
City	Virtual, Online
Period	25/10/20 → 29/10/20
Internet address	http://icmi.acm.org/2020/

Keywords

Annotation
Emotion detection
Interview data
NLP
Speech processing
Transcription
22/2 OA procedure

Access to Document

10.1145/3382507.3420054

ArticleFinal published version, 1.53 MBLicence: Taverne

Cite this

Hessen, A. V., Calamai, S., Heuvel, H. V. D., Scagliola, S., Karrouche, N., Beeken, J., Corti, L., & Draxler, C. (2020). Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the use of digital tools. In ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction (pp. 886-887). Association for Computing Machinery. https://doi.org/10.1145/3382507.3420054

@inproceedings{9f4abc0984ec4fd99e3ae6c4563fb699,

title = "Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the use of digital tools",

abstract = "Interview data is multimodal data: it consists of speech sound, facial expression and gestures, captured in a particular situation, and containing textual information and emotion. This workshop shows how a multidisciplinary approach may exploit the full potential of interview data. The workshop first gives a systematic overview of the research fields working with interview data. It then presents the speech technology currently available to support transcribing and annotating interview data, such as automatic speech recognition, speaker diarization, and emotion detection. Finally, scholars who work with interview data and tools may present their work and discover how to make use of existing technology. ",

keywords = "Annotation, Emotion detection, Interview data, NLP, Speech processing, Transcription, 22/2 OA procedure",

author = "Hessen, {Arjan Van} and Silvia Calamai and Heuvel, {Henk Van Den} and Stefania Scagliola and Norah Karrouche and Jeannine Beeken and Louise Corti and Christoph Draxler",

note = "Publisher Copyright: {\textcopyright} 2020 ACM.; 22nd ACM International Conference on Multimodal Interaction, ICMI 2020, ICMI ; Conference date: 25-10-2020 Through 29-10-2020",

year = "2020",

month = oct,

day = "22",

doi = "10.1145/3382507.3420054",

language = "English",

pages = "886--887",

booktitle = "ICMI '20",

publisher = "Association for Computing Machinery",

address = "United States",

url = "http://icmi.acm.org/2020/",

}

Hessen, AV, Calamai, S, Heuvel, HVD, Scagliola, S, Karrouche, N, Beeken, J, Corti, L & Draxler, C 2020, Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the use of digital tools. in ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction. Association for Computing Machinery, New York, NY, pp. 886-887, 22nd ACM International Conference on Multimodal Interaction, ICMI 2020, Virtual, Online, Netherlands, 25/10/20. https://doi.org/10.1145/3382507.3420054

Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the use of digital tools. / Hessen, Arjan Van; Calamai, Silvia; Heuvel, Henk Van Den et al.
ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction. New York, NY: Association for Computing Machinery, 2020. p. 886-887.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Speech, Voice, Text, and Meaning

T2 - 22nd ACM International Conference on Multimodal Interaction, ICMI 2020

AU - Hessen, Arjan Van

AU - Calamai, Silvia

AU - Heuvel, Henk Van Den

AU - Scagliola, Stefania

AU - Karrouche, Norah

AU - Beeken, Jeannine

AU - Corti, Louise

AU - Draxler, Christoph

N1 - Conference code: 22

PY - 2020/10/22

Y1 - 2020/10/22

N2 - Interview data is multimodal data: it consists of speech sound, facial expression and gestures, captured in a particular situation, and containing textual information and emotion. This workshop shows how a multidisciplinary approach may exploit the full potential of interview data. The workshop first gives a systematic overview of the research fields working with interview data. It then presents the speech technology currently available to support transcribing and annotating interview data, such as automatic speech recognition, speaker diarization, and emotion detection. Finally, scholars who work with interview data and tools may present their work and discover how to make use of existing technology.

AB - Interview data is multimodal data: it consists of speech sound, facial expression and gestures, captured in a particular situation, and containing textual information and emotion. This workshop shows how a multidisciplinary approach may exploit the full potential of interview data. The workshop first gives a systematic overview of the research fields working with interview data. It then presents the speech technology currently available to support transcribing and annotating interview data, such as automatic speech recognition, speaker diarization, and emotion detection. Finally, scholars who work with interview data and tools may present their work and discover how to make use of existing technology.

KW - Annotation

KW - Emotion detection

KW - Interview data

KW - NLP

KW - Speech processing

KW - Transcription

KW - 22/2 OA procedure

UR - http://www.scopus.com/inward/record.url?scp=85096648431&partnerID=8YFLogxK

U2 - 10.1145/3382507.3420054

DO - 10.1145/3382507.3420054

M3 - Conference contribution

AN - SCOPUS:85096648431

SP - 886

EP - 887

BT - ICMI '20

PB - Association for Computing Machinery

CY - New York, NY

Y2 - 25 October 2020 through 29 October 2020

ER -

Hessen AV, Calamai S, Heuvel HVD, Scagliola S, Karrouche N, Beeken J et al. Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the use of digital tools. In ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction. New York, NY: Association for Computing Machinery. 2020. p. 886-887 doi: 10.1145/3382507.3420054

Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the use of digital tools

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this