Serious Games Application for Memory Training Using Egocentric Images: Workshop on Social Signal Processing and Beyond

Gabriel Oliveira-Barra; Marc Bolanos; Estefanía Talavera; Olga Gelonch; Maite Garolera

doi:10.1007/978-3-319-70742-6_11

Serious Games Application for Memory Training Using Egocentric Images: Workshop on Social Signal Processing and Beyond

Gabriel Oliveira-Barra
, Marc Bolanos^*
, Estefanía Talavera
, Olga Gelonch
, Maite Garolera

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

1 Citation (Scopus)

17 Downloads (Pure)

Abstract

Mild cognitive impairment is the early stage of several neurodegenerative diseases, such as Alzheimer's. In this work, we address the use of lifelogging as a tool to obtain pictures from a patient's daily life from an egocentric point of view. We propose to use them in combination with serious games as a way to provide a non-pharmacological treatment to improve their quality of life. To do so, we introduce a novel computer vision technique that classifies rich and non rich egocentric images and uses them in serious games. We present results over a dataset composed by 10,997 images, recorded by 7 different users, achieving 79\% of F1-score. Our model presents the first method used for automatic egocentric images selection applicable to serious games.

Original language	English
Title of host publication	New Trends in Image Analysis and Processing – ICIAP 2017
Subtitle of host publication	ICIAP International Workshops, WBICV, SSPandBE, 3AS, RGBD, NIVAR, IWBAAS, and MADiMa 2017, Catania, Italy, September 11-15, 2017, Revised Selected Papers
Editors	Sebastiano Battiato, Giovanni Maria Farinella, Marco Leo, Giovanni Gallo
Publisher	Springer
Pages	120-130
ISBN (Electronic)	978-3-319-70742-6
ISBN (Print)	978-3-319-70741-9
DOIs	https://doi.org/10.1007/978-3-319-70742-6_11
Publication status	Published - Dec 2017
Externally published	Yes
Event	19th International Conference on Image Analysis and Processing, ICIAP 2017 - Catania, Italy Duration: 11 Sept 2017 → 15 Sept 2017 Conference number: 19

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	10590
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	19th International Conference on Image Analysis and Processing, ICIAP 2017
Abbreviated title	ICIAP 2017
Country/Territory	Italy
City	Catania
Period	11/09/17 → 15/09/17

Keywords

Lifelogging
Machine learning
Serious games
Egocentric vision
Mild cognitive impairment
Computer vision

Access to Document

10.1007/978-3-319-70742-6_11

Oliveira-Barra2017seriousAccepted author version, 4.66 MB

Cite this

Oliveira-Barra, G., Bolanos, M., Talavera, E., Gelonch, O., & Garolera, M. (2017). Serious Games Application for Memory Training Using Egocentric Images: Workshop on Social Signal Processing and Beyond. In S. Battiato, G. M. Farinella, M. Leo, & G. Gallo (Eds.), New Trends in Image Analysis and Processing – ICIAP 2017: ICIAP International Workshops, WBICV, SSPandBE, 3AS, RGBD, NIVAR, IWBAAS, and MADiMa 2017, Catania, Italy, September 11-15, 2017, Revised Selected Papers (pp. 120-130). (Lecture Notes in Computer Science; Vol. 10590). Springer. https://doi.org/10.1007/978-3-319-70742-6_11

Oliveira-Barra, Gabriel ; Bolanos, Marc ; Talavera, Estefanía et al. / Serious Games Application for Memory Training Using Egocentric Images : Workshop on Social Signal Processing and Beyond. New Trends in Image Analysis and Processing – ICIAP 2017: ICIAP International Workshops, WBICV, SSPandBE, 3AS, RGBD, NIVAR, IWBAAS, and MADiMa 2017, Catania, Italy, September 11-15, 2017, Revised Selected Papers. editor / Sebastiano Battiato ; Giovanni Maria Farinella ; Marco Leo ; Giovanni Gallo. Springer, 2017. pp. 120-130 (Lecture Notes in Computer Science).

@inproceedings{1e0016e5237d4593b2e781d4cb8ab11d,

title = "Serious Games Application for Memory Training Using Egocentric Images: Workshop on Social Signal Processing and Beyond",

abstract = "Mild cognitive impairment is the early stage of several neurodegenerative diseases, such as Alzheimer's. In this work, we address the use of lifelogging as a tool to obtain pictures from a patient's daily life from an egocentric point of view. We propose to use them in combination with serious games as a way to provide a non-pharmacological treatment to improve their quality of life. To do so, we introduce a novel computer vision technique that classifies rich and non rich egocentric images and uses them in serious games. We present results over a dataset composed by 10,997 images, recorded by 7 different users, achieving 79\textbackslash{}\% of F1-score. Our model presents the first method used for automatic egocentric images selection applicable to serious games.",

keywords = "Lifelogging, Machine learning, Serious games, Egocentric vision, Mild cognitive impairment, Computer vision",

author = "Gabriel Oliveira-Barra and Marc Bolanos and Estefan{\'i}a Talavera and Olga Gelonch and Maite Garolera",

year = "2017",

month = dec,

doi = "10.1007/978-3-319-70742-6\_11",

language = "English",

isbn = "978-3-319-70741-9",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "120--130",

editor = "Sebastiano Battiato and Farinella, \{Giovanni Maria\} and Marco Leo and Giovanni Gallo",

booktitle = "New Trends in Image Analysis and Processing – ICIAP 2017",

address = "Germany",

note = "19th International Conference on Image Analysis and Processing, ICIAP 2017, ICIAP 2017 ; Conference date: 11-09-2017 Through 15-09-2017",

}

Oliveira-Barra, G, Bolanos, M, Talavera, E, Gelonch, O & Garolera, M 2017, Serious Games Application for Memory Training Using Egocentric Images: Workshop on Social Signal Processing and Beyond. in S Battiato, GM Farinella, M Leo & G Gallo (eds), New Trends in Image Analysis and Processing – ICIAP 2017: ICIAP International Workshops, WBICV, SSPandBE, 3AS, RGBD, NIVAR, IWBAAS, and MADiMa 2017, Catania, Italy, September 11-15, 2017, Revised Selected Papers. Lecture Notes in Computer Science, vol. 10590, Springer, pp. 120-130, 19th International Conference on Image Analysis and Processing, ICIAP 2017, Catania, Italy, 11/09/17. https://doi.org/10.1007/978-3-319-70742-6_11

Serious Games Application for Memory Training Using Egocentric Images: Workshop on Social Signal Processing and Beyond. / Oliveira-Barra, Gabriel; Bolanos, Marc; Talavera, Estefanía et al.
New Trends in Image Analysis and Processing – ICIAP 2017: ICIAP International Workshops, WBICV, SSPandBE, 3AS, RGBD, NIVAR, IWBAAS, and MADiMa 2017, Catania, Italy, September 11-15, 2017, Revised Selected Papers. ed. / Sebastiano Battiato; Giovanni Maria Farinella; Marco Leo; Giovanni Gallo. Springer, 2017. p. 120-130 (Lecture Notes in Computer Science; Vol. 10590).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Serious Games Application for Memory Training Using Egocentric Images

T2 - 19th International Conference on Image Analysis and Processing, ICIAP 2017

AU - Oliveira-Barra, Gabriel

AU - Bolanos, Marc

AU - Talavera, Estefanía

AU - Gelonch, Olga

AU - Garolera, Maite

N1 - Conference code: 19

PY - 2017/12

Y1 - 2017/12

N2 - Mild cognitive impairment is the early stage of several neurodegenerative diseases, such as Alzheimer's. In this work, we address the use of lifelogging as a tool to obtain pictures from a patient's daily life from an egocentric point of view. We propose to use them in combination with serious games as a way to provide a non-pharmacological treatment to improve their quality of life. To do so, we introduce a novel computer vision technique that classifies rich and non rich egocentric images and uses them in serious games. We present results over a dataset composed by 10,997 images, recorded by 7 different users, achieving 79\% of F1-score. Our model presents the first method used for automatic egocentric images selection applicable to serious games.

AB - Mild cognitive impairment is the early stage of several neurodegenerative diseases, such as Alzheimer's. In this work, we address the use of lifelogging as a tool to obtain pictures from a patient's daily life from an egocentric point of view. We propose to use them in combination with serious games as a way to provide a non-pharmacological treatment to improve their quality of life. To do so, we introduce a novel computer vision technique that classifies rich and non rich egocentric images and uses them in serious games. We present results over a dataset composed by 10,997 images, recorded by 7 different users, achieving 79\% of F1-score. Our model presents the first method used for automatic egocentric images selection applicable to serious games.

KW - Lifelogging

KW - Machine learning

KW - Serious games

KW - Egocentric vision

KW - Mild cognitive impairment

KW - Computer vision

U2 - 10.1007/978-3-319-70742-6_11

DO - 10.1007/978-3-319-70742-6_11

M3 - Conference contribution

SN - 978-3-319-70741-9

T3 - Lecture Notes in Computer Science

SP - 120

EP - 130

BT - New Trends in Image Analysis and Processing – ICIAP 2017

A2 - Battiato, Sebastiano

A2 - Farinella, Giovanni Maria

A2 - Leo, Marco

A2 - Gallo, Giovanni

PB - Springer

Y2 - 11 September 2017 through 15 September 2017

ER -

Oliveira-Barra G, Bolanos M, Talavera E, Gelonch O, Garolera M. Serious Games Application for Memory Training Using Egocentric Images: Workshop on Social Signal Processing and Beyond. In Battiato S, Farinella GM, Leo M, Gallo G, editors, New Trends in Image Analysis and Processing – ICIAP 2017: ICIAP International Workshops, WBICV, SSPandBE, 3AS, RGBD, NIVAR, IWBAAS, and MADiMa 2017, Catania, Italy, September 11-15, 2017, Revised Selected Papers. Springer. 2017. p. 120-130. (Lecture Notes in Computer Science). doi: 10.1007/978-3-319-70742-6_11

Serious Games Application for Memory Training Using Egocentric Images: Workshop on Social Signal Processing and Beyond

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this