Automated speech and audio analysis for semantic access to multimedia

Franciska M.G. de Jong; Roeland J.F. Ordelman; M.A.H. Huijbregts

doi:10.1007/11930334_18

Automated speech and audio analysis for semantic access to multimedia

Franciska M.G. de Jong, Roeland J.F. Ordelman, M.A.H. Huijbregts

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

10 Citations (Scopus)

56 Downloads (Pure)

Abstract

The deployment and integration of audio processing tools can enhance the semantic annotation of multimedia content, and as a consequence, improve the effectiveness of conceptual access tools. This paper overviews the various ways in which automatic speech and audio analysis can contribute to increased granularity of automatically extracted metadata. A number of techniques will be presented, including the alignment of speech and text resources, large vocabulary speech recognition, key word spotting and speaker classification. The applicability of techniques will be discussed from a media crossing perspective. The added value of the techniques and their potential contribution to the content value chain will be illustrated by the description of two (complementary) demonstrators for browsing broadcast news archives.

Original language	Undefined
Title of host publication	Proceedings of the First International Conference on Semantic and Digital Media Technologies, SAMT 2006
Editors	Y. Avrithis, Y. Kompatsiaris, S. Staab, N.E. O' Connor
Place of Publication	Berlin
Publisher	Springer
Pages	226-240
Number of pages	15
ISBN (Print)	3-540-49335-2
DOIs	https://doi.org/10.1007/11930334_18
Publication status	Published - 6 Dec 2006

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer Verlag
Number	06EX1521
Volume	4306

Keywords

HMI-SLT: Speech and Language Technology
HMI-MR: MULTIMEDIA RETRIEVAL
EC Grant Agreement nr.: FP6/506811
IR-66586
EWI-8073
EC Grant Agreement nr.: FP6/027413
METIS-237582
EC Grant Agreement nr.: FP6/027685

Access to Document

10.1007/11930334_18

samt2006
open
samt2006
open

Cite this

de Jong, F. M. G., Ordelman, R. J. F., & Huijbregts, M. A. H. (2006). Automated speech and audio analysis for semantic access to multimedia. In Y. Avrithis, Y. Kompatsiaris, S. Staab, & N. E. O' Connor (Eds.), Proceedings of the First International Conference on Semantic and Digital Media Technologies, SAMT 2006 (pp. 226-240). [10.1007/11930334_18] (Lecture Notes in Computer Science; Vol. 4306, No. 06EX1521). Berlin: Springer. https://doi.org/10.1007/11930334_18

de Jong, Franciska M.G. ; Ordelman, Roeland J.F. ; Huijbregts, M.A.H. / Automated speech and audio analysis for semantic access to multimedia. Proceedings of the First International Conference on Semantic and Digital Media Technologies, SAMT 2006. editor / Y. Avrithis ; Y. Kompatsiaris ; S. Staab ; N.E. O' Connor. Berlin : Springer, 2006. pp. 226-240 (Lecture Notes in Computer Science; 06EX1521).

@inproceedings{413754af753940d0aef4cc52b9361ba0,

title = "Automated speech and audio analysis for semantic access to multimedia",

abstract = "The deployment and integration of audio processing tools can enhance the semantic annotation of multimedia content, and as a consequence, improve the effectiveness of conceptual access tools. This paper overviews the various ways in which automatic speech and audio analysis can contribute to increased granularity of automatically extracted metadata. A number of techniques will be presented, including the alignment of speech and text resources, large vocabulary speech recognition, key word spotting and speaker classification. The applicability of techniques will be discussed from a media crossing perspective. The added value of the techniques and their potential contribution to the content value chain will be illustrated by the description of two (complementary) demonstrators for browsing broadcast news archives.",

keywords = "HMI-SLT: Speech and Language Technology, HMI-MR: MULTIMEDIA RETRIEVAL, EC Grant Agreement nr.: FP6/506811, IR-66586, EWI-8073, EC Grant Agreement nr.: FP6/027413, METIS-237582, EC Grant Agreement nr.: FP6/027685",

author = "{de Jong}, {Franciska M.G.} and Ordelman, {Roeland J.F.} and M.A.H. Huijbregts",

note = "10.1007/11930334_18",

year = "2006",

month = "12",

day = "6",

doi = "10.1007/11930334_18",

language = "Undefined",

isbn = "3-540-49335-2",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

number = "06EX1521",

pages = "226--240",

editor = "Y. Avrithis and Y. Kompatsiaris and S. Staab and {O' Connor}, N.E.",

booktitle = "Proceedings of the First International Conference on Semantic and Digital Media Technologies, SAMT 2006",

}

de Jong, FMG , Ordelman, RJF & Huijbregts, MAH 2006, Automated speech and audio analysis for semantic access to multimedia. in Y Avrithis, Y Kompatsiaris, S Staab & NE O' Connor (eds), Proceedings of the First International Conference on Semantic and Digital Media Technologies, SAMT 2006., 10.1007/11930334_18, Lecture Notes in Computer Science, no. 06EX1521, vol. 4306, Springer, Berlin, pp. 226-240. https://doi.org/10.1007/11930334_18

Automated speech and audio analysis for semantic access to multimedia. / de Jong, Franciska M.G.; Ordelman, Roeland J.F.; Huijbregts, M.A.H.

Proceedings of the First International Conference on Semantic and Digital Media Technologies, SAMT 2006. ed. / Y. Avrithis; Y. Kompatsiaris; S. Staab; N.E. O' Connor. Berlin : Springer, 2006. p. 226-240 10.1007/11930334_18 (Lecture Notes in Computer Science; Vol. 4306, No. 06EX1521).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Automated speech and audio analysis for semantic access to multimedia

AU - de Jong, Franciska M.G.

AU - Ordelman, Roeland J.F.

AU - Huijbregts, M.A.H.

N1 - 10.1007/11930334_18

PY - 2006/12/6

Y1 - 2006/12/6

N2 - The deployment and integration of audio processing tools can enhance the semantic annotation of multimedia content, and as a consequence, improve the effectiveness of conceptual access tools. This paper overviews the various ways in which automatic speech and audio analysis can contribute to increased granularity of automatically extracted metadata. A number of techniques will be presented, including the alignment of speech and text resources, large vocabulary speech recognition, key word spotting and speaker classification. The applicability of techniques will be discussed from a media crossing perspective. The added value of the techniques and their potential contribution to the content value chain will be illustrated by the description of two (complementary) demonstrators for browsing broadcast news archives.

AB - The deployment and integration of audio processing tools can enhance the semantic annotation of multimedia content, and as a consequence, improve the effectiveness of conceptual access tools. This paper overviews the various ways in which automatic speech and audio analysis can contribute to increased granularity of automatically extracted metadata. A number of techniques will be presented, including the alignment of speech and text resources, large vocabulary speech recognition, key word spotting and speaker classification. The applicability of techniques will be discussed from a media crossing perspective. The added value of the techniques and their potential contribution to the content value chain will be illustrated by the description of two (complementary) demonstrators for browsing broadcast news archives.

KW - HMI-SLT: Speech and Language Technology

KW - HMI-MR: MULTIMEDIA RETRIEVAL

KW - EC Grant Agreement nr.: FP6/506811

KW - IR-66586

KW - EWI-8073

KW - EC Grant Agreement nr.: FP6/027413

KW - METIS-237582

KW - EC Grant Agreement nr.: FP6/027685

U2 - 10.1007/11930334_18

DO - 10.1007/11930334_18

M3 - Conference contribution

SN - 3-540-49335-2

T3 - Lecture Notes in Computer Science

SP - 226

EP - 240

BT - Proceedings of the First International Conference on Semantic and Digital Media Technologies, SAMT 2006

A2 - Avrithis, Y.

A2 - Kompatsiaris, Y.

A2 - Staab, S.

A2 - O' Connor, N.E.

PB - Springer

CY - Berlin

ER -

de Jong FMG , Ordelman RJF, Huijbregts MAH. Automated speech and audio analysis for semantic access to multimedia. In Avrithis Y, Kompatsiaris Y, Staab S, O' Connor NE, editors, Proceedings of the First International Conference on Semantic and Digital Media Technologies, SAMT 2006. Berlin: Springer. 2006. p. 226-240. 10.1007/11930334_18. (Lecture Notes in Computer Science; 06EX1521). https://doi.org/10.1007/11930334_18