Looking around with your brain in a virtual world

D. Plass - Oude Bos; Matthieu Duvinage; Oytun Oktay; Jaime Delgado Saa; Huseyin Guruler; Ayhan Istanbullu; Marijn van Vliet; B.L.A. van de Laar; Mannes Poel; Linsey Roijendijk; Luca Tonin; Ali Bahramisharif; B. Reuderink

doi:10.1109/CCMB.2011.5952110

Looking around with your brain in a virtual world

D. Plass - Oude Bos
, Matthieu Duvinage
, Oytun Oktay
, Jaime Delgado Saa
, Huseyin Guruler
, Ayhan Istanbullu
, Marijn van Vliet
, B.L.A. van de Laar
, Mannes Poel
, Linsey Roijendijk
, Luca Tonin
, Ali Bahramisharif
, B. Reuderink

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

5 Citations (Scopus)

Abstract

Offline analysis pipelines have been developed and evaluated for the detection of covert attention from electroen-cephalography recordings, and the detection of overt attention in terms of eye movement based on electrooculographic measurements. Some additional analysis were done in order to prepare the pipelines for use in a real-time system. This real-time system and a game application in which these pipelines are to be used were implemented. The game is set in a virtual environment where player is a wildlife photographer on an uninhabited island. Overt attention is used to adjust the angle of the first person camera, when the player is tracking animals. When making a photograph, the animal will flee when it notices it is looked at directly, so covert attention is required to get a good shot. Future work will entail user tests with this system to evaluate usability, user experience, and characteristics of the signals related to overt and covert attention when used in such an immersive environment.

Original language	Undefined
Title of host publication	IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB 2011)
Place of Publication	USA
Publisher	IEEE
Pages	1-8
Number of pages	8
ISBN (Print)	978-1-4244-9890-1
DOIs	https://doi.org/10.1109/CCMB.2011.5952110
Publication status	Published - Apr 2011
Event	IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain, CCMB 2011 - Paris, France Duration: 11 Apr 2011 → 15 Apr 2011

Publication series

Name
Publisher	IEEE Computational Intelligence Society

Conference

Conference	IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain, CCMB 2011
Period	11/04/11 → 15/04/11
Other	11-15 April 2011

Keywords

IR-79206
METIS-285200
electroencephalography
electrooculography
EEG
EWI-19402
Games
Brain-Computer Interfaces
Brain-Computer Interaction
HMI-MI: MULTIMODAL INTERACTIONS
EOG

Access to Document

10.1109/CCMB.2011.5952110

http://eprints.eemcs.utwente.nl/secure2/19402/01/05952110.pdf

Cite this

Plass - Oude Bos, D., Duvinage, M., Oktay, O., Delgado Saa, J., Guruler, H., Istanbullu, A., van Vliet, M., van de Laar, B. L. A., Poel, M., Roijendijk, L., Tonin, L., Bahramisharif, A., & Reuderink, B. (2011). Looking around with your brain in a virtual world. In IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB 2011) (pp. 1-8). IEEE. https://doi.org/10.1109/CCMB.2011.5952110

@inproceedings{d22a18f7d2714a78a90a330ec0ec1474,

title = "Looking around with your brain in a virtual world",

abstract = "Offline analysis pipelines have been developed and evaluated for the detection of covert attention from electroen-cephalography recordings, and the detection of overt attention in terms of eye movement based on electrooculographic measurements. Some additional analysis were done in order to prepare the pipelines for use in a real-time system. This real-time system and a game application in which these pipelines are to be used were implemented. The game is set in a virtual environment where player is a wildlife photographer on an uninhabited island. Overt attention is used to adjust the angle of the first person camera, when the player is tracking animals. When making a photograph, the animal will flee when it notices it is looked at directly, so covert attention is required to get a good shot. Future work will entail user tests with this system to evaluate usability, user experience, and characteristics of the signals related to overt and covert attention when used in such an immersive environment.",

keywords = "IR-79206, METIS-285200, electroencephalography, electrooculography, EEG, EWI-19402, Games, Brain-Computer Interfaces, Brain-Computer Interaction, HMI-MI: MULTIMODAL INTERACTIONS, EOG",

author = "\{Plass - Oude Bos\}, D. and Matthieu Duvinage and Oytun Oktay and \{Delgado Saa\}, Jaime and Huseyin Guruler and Ayhan Istanbullu and \{van Vliet\}, Marijn and \{van de Laar\}, B.L.A. and Mannes Poel and Linsey Roijendijk and Luca Tonin and Ali Bahramisharif and B. Reuderink",

note = "10.1109/CCMB.2011.5952110 ; IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain, CCMB 2011 ; Conference date: 11-04-2011 Through 15-04-2011",

year = "2011",

month = apr,

doi = "10.1109/CCMB.2011.5952110",

language = "Undefined",

isbn = "978-1-4244-9890-1",

publisher = "IEEE",

pages = "1--8",

booktitle = "IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB 2011)",

address = "United States",

}

Plass - Oude Bos, D, Duvinage, M, Oktay, O, Delgado Saa, J, Guruler, H, Istanbullu, A, van Vliet, M, van de Laar, BLA, Poel, M, Roijendijk, L, Tonin, L, Bahramisharif, A & Reuderink, B 2011, Looking around with your brain in a virtual world. in IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB 2011). IEEE, USA, pp. 1-8, IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain, CCMB 2011, 11/04/11. https://doi.org/10.1109/CCMB.2011.5952110

TY - GEN

T1 - Looking around with your brain in a virtual world

AU - Plass - Oude Bos, D.

AU - Duvinage, Matthieu

AU - Oktay, Oytun

AU - Delgado Saa, Jaime

AU - Guruler, Huseyin

AU - Istanbullu, Ayhan

AU - van Vliet, Marijn

AU - van de Laar, B.L.A.

AU - Poel, Mannes

AU - Roijendijk, Linsey

AU - Tonin, Luca

AU - Bahramisharif, Ali

AU - Reuderink, B.

N1 - 10.1109/CCMB.2011.5952110

PY - 2011/4

Y1 - 2011/4

N2 - Offline analysis pipelines have been developed and evaluated for the detection of covert attention from electroen-cephalography recordings, and the detection of overt attention in terms of eye movement based on electrooculographic measurements. Some additional analysis were done in order to prepare the pipelines for use in a real-time system. This real-time system and a game application in which these pipelines are to be used were implemented. The game is set in a virtual environment where player is a wildlife photographer on an uninhabited island. Overt attention is used to adjust the angle of the first person camera, when the player is tracking animals. When making a photograph, the animal will flee when it notices it is looked at directly, so covert attention is required to get a good shot. Future work will entail user tests with this system to evaluate usability, user experience, and characteristics of the signals related to overt and covert attention when used in such an immersive environment.

AB - Offline analysis pipelines have been developed and evaluated for the detection of covert attention from electroen-cephalography recordings, and the detection of overt attention in terms of eye movement based on electrooculographic measurements. Some additional analysis were done in order to prepare the pipelines for use in a real-time system. This real-time system and a game application in which these pipelines are to be used were implemented. The game is set in a virtual environment where player is a wildlife photographer on an uninhabited island. Overt attention is used to adjust the angle of the first person camera, when the player is tracking animals. When making a photograph, the animal will flee when it notices it is looked at directly, so covert attention is required to get a good shot. Future work will entail user tests with this system to evaluate usability, user experience, and characteristics of the signals related to overt and covert attention when used in such an immersive environment.

KW - IR-79206

KW - METIS-285200

KW - electroencephalography

KW - electrooculography

KW - EEG

KW - EWI-19402

KW - Games

KW - Brain-Computer Interfaces

KW - Brain-Computer Interaction

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - EOG

U2 - 10.1109/CCMB.2011.5952110

DO - 10.1109/CCMB.2011.5952110

M3 - Conference contribution

SN - 978-1-4244-9890-1

SP - 1

EP - 8

BT - IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB 2011)

PB - IEEE

CY - USA

T2 - IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain, CCMB 2011

Y2 - 11 April 2011 through 15 April 2011

ER -