Multi-Brain Computing: BCI Monitoring and Real-Time Decision Making

Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

1 Downloads (Pure)

Abstract

In this chapter we survey recent research on multi-brain applications. That is, applications in which synchronized brain activity of multiple users is measured and integrated in order to use their joint brain activity to make real-time decisions about communication with and control of devices in smart environments. Interestingly, we can go back to early brain-computer interface research of 1970 to see many ideas and sometimes implementations of synchronized multi-brain "computing". Usually they can be found in the artistic domain. In this decade (2010-20) we see growing attention in this research area, partly because of the availability of affordable electroencephalograhic (EEG) devices and partly because of the interest of human-computer interaction researchers in affective computing. This additional interest is now responsible for a focus on brain-computer interface (BCI) research that has changed from clinical applications to applications that are of interest to industry, specific groups of professionals or to the general population. Traditional BCI researchers are not always open to these developments, in which rather than focusing on Amyotrophic Lateral Sclerosis (ALS) patients, this new research focuses on entertainment, games, art and playful applications in the domestic and public domains. Among the many applications of multibrain computing: (1) Joint decision-making in environments requiring high accuracy and/or rapid reactions, or feedback; (2) joint/shared control and movement planning of vehicles or robots; (3) assess team performance, stress-aware task allocation, rearrange tasks; (4) characterization of group emotions, preferences, appreciations; (5) social interaction research (two or more people), (6) arts, entertainment, games. We discuss some examples from multibrain computing and focus on possible ways of joint decision making (or otherwise using the measured brain activity of multiple users). We will also emphasize the possibilities that are offered by the multimodal context, that is, considering brain-computer interfacing as one of the many possible modalities to obtain information about a user's or a group of users' affective states, preferences, and decisions. How to fuse information coming from different modalities and from different users need to be discussed. For that, we can learn from multimodal interaction research in human-computer interaction, including observations on sequential and parallel multimodality.
Original languageEnglish
Title of host publicationNeuroergonomics: The Brain at Work and in Everyday Life
EditorsHasan Ayaz, Frederic Dehais
PublisherElsevier
Chapter56
Pages243
Number of pages1
ISBN (Electronic)9780128119273
ISBN (Print)9780128119266
DOIs
Publication statusPublished - 1 Nov 2018

Fingerprint

Brain computer interface
Brain
Decision making
Monitoring
Human computer interaction
Electric fuses
Availability
Robots
Feedback
Planning
Communication

Keywords

  • Brain-Computer Interfaces (BCI)

Cite this

Nijholt, A. (2018). Multi-Brain Computing: BCI Monitoring and Real-Time Decision Making. In H. Ayaz, & F. Dehais (Eds.), Neuroergonomics: The Brain at Work and in Everyday Life (pp. 243). Elsevier. https://doi.org/10.1016/B978-0-12-811926-6.00056-7
Nijholt, Anton. / Multi-Brain Computing: BCI Monitoring and Real-Time Decision Making. Neuroergonomics: The Brain at Work and in Everyday Life. editor / Hasan Ayaz ; Frederic Dehais. Elsevier, 2018. pp. 243
@inbook{837ce6c8fdf64245a078736167266ef2,
title = "Multi-Brain Computing: BCI Monitoring and Real-Time Decision Making",
abstract = "In this chapter we survey recent research on multi-brain applications. That is, applications in which synchronized brain activity of multiple users is measured and integrated in order to use their joint brain activity to make real-time decisions about communication with and control of devices in smart environments. Interestingly, we can go back to early brain-computer interface research of 1970 to see many ideas and sometimes implementations of synchronized multi-brain {"}computing{"}. Usually they can be found in the artistic domain. In this decade (2010-20) we see growing attention in this research area, partly because of the availability of affordable electroencephalograhic (EEG) devices and partly because of the interest of human-computer interaction researchers in affective computing. This additional interest is now responsible for a focus on brain-computer interface (BCI) research that has changed from clinical applications to applications that are of interest to industry, specific groups of professionals or to the general population. Traditional BCI researchers are not always open to these developments, in which rather than focusing on Amyotrophic Lateral Sclerosis (ALS) patients, this new research focuses on entertainment, games, art and playful applications in the domestic and public domains. Among the many applications of multibrain computing: (1) Joint decision-making in environments requiring high accuracy and/or rapid reactions, or feedback; (2) joint/shared control and movement planning of vehicles or robots; (3) assess team performance, stress-aware task allocation, rearrange tasks; (4) characterization of group emotions, preferences, appreciations; (5) social interaction research (two or more people), (6) arts, entertainment, games. We discuss some examples from multibrain computing and focus on possible ways of joint decision making (or otherwise using the measured brain activity of multiple users). We will also emphasize the possibilities that are offered by the multimodal context, that is, considering brain-computer interfacing as one of the many possible modalities to obtain information about a user's or a group of users' affective states, preferences, and decisions. How to fuse information coming from different modalities and from different users need to be discussed. For that, we can learn from multimodal interaction research in human-computer interaction, including observations on sequential and parallel multimodality.",
keywords = "Brain-Computer Interfaces (BCI)",
author = "Anton Nijholt",
year = "2018",
month = "11",
day = "1",
doi = "10.1016/B978-0-12-811926-6.00056-7",
language = "English",
isbn = "9780128119266",
pages = "243",
editor = "Hasan Ayaz and Frederic Dehais",
booktitle = "Neuroergonomics: The Brain at Work and in Everyday Life",
publisher = "Elsevier",

}

Nijholt, A 2018, Multi-Brain Computing: BCI Monitoring and Real-Time Decision Making. in H Ayaz & F Dehais (eds), Neuroergonomics: The Brain at Work and in Everyday Life. Elsevier, pp. 243. https://doi.org/10.1016/B978-0-12-811926-6.00056-7

Multi-Brain Computing: BCI Monitoring and Real-Time Decision Making. / Nijholt, Anton.

Neuroergonomics: The Brain at Work and in Everyday Life. ed. / Hasan Ayaz; Frederic Dehais. Elsevier, 2018. p. 243.

Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

TY - CHAP

T1 - Multi-Brain Computing: BCI Monitoring and Real-Time Decision Making

AU - Nijholt, Anton

PY - 2018/11/1

Y1 - 2018/11/1

N2 - In this chapter we survey recent research on multi-brain applications. That is, applications in which synchronized brain activity of multiple users is measured and integrated in order to use their joint brain activity to make real-time decisions about communication with and control of devices in smart environments. Interestingly, we can go back to early brain-computer interface research of 1970 to see many ideas and sometimes implementations of synchronized multi-brain "computing". Usually they can be found in the artistic domain. In this decade (2010-20) we see growing attention in this research area, partly because of the availability of affordable electroencephalograhic (EEG) devices and partly because of the interest of human-computer interaction researchers in affective computing. This additional interest is now responsible for a focus on brain-computer interface (BCI) research that has changed from clinical applications to applications that are of interest to industry, specific groups of professionals or to the general population. Traditional BCI researchers are not always open to these developments, in which rather than focusing on Amyotrophic Lateral Sclerosis (ALS) patients, this new research focuses on entertainment, games, art and playful applications in the domestic and public domains. Among the many applications of multibrain computing: (1) Joint decision-making in environments requiring high accuracy and/or rapid reactions, or feedback; (2) joint/shared control and movement planning of vehicles or robots; (3) assess team performance, stress-aware task allocation, rearrange tasks; (4) characterization of group emotions, preferences, appreciations; (5) social interaction research (two or more people), (6) arts, entertainment, games. We discuss some examples from multibrain computing and focus on possible ways of joint decision making (or otherwise using the measured brain activity of multiple users). We will also emphasize the possibilities that are offered by the multimodal context, that is, considering brain-computer interfacing as one of the many possible modalities to obtain information about a user's or a group of users' affective states, preferences, and decisions. How to fuse information coming from different modalities and from different users need to be discussed. For that, we can learn from multimodal interaction research in human-computer interaction, including observations on sequential and parallel multimodality.

AB - In this chapter we survey recent research on multi-brain applications. That is, applications in which synchronized brain activity of multiple users is measured and integrated in order to use their joint brain activity to make real-time decisions about communication with and control of devices in smart environments. Interestingly, we can go back to early brain-computer interface research of 1970 to see many ideas and sometimes implementations of synchronized multi-brain "computing". Usually they can be found in the artistic domain. In this decade (2010-20) we see growing attention in this research area, partly because of the availability of affordable electroencephalograhic (EEG) devices and partly because of the interest of human-computer interaction researchers in affective computing. This additional interest is now responsible for a focus on brain-computer interface (BCI) research that has changed from clinical applications to applications that are of interest to industry, specific groups of professionals or to the general population. Traditional BCI researchers are not always open to these developments, in which rather than focusing on Amyotrophic Lateral Sclerosis (ALS) patients, this new research focuses on entertainment, games, art and playful applications in the domestic and public domains. Among the many applications of multibrain computing: (1) Joint decision-making in environments requiring high accuracy and/or rapid reactions, or feedback; (2) joint/shared control and movement planning of vehicles or robots; (3) assess team performance, stress-aware task allocation, rearrange tasks; (4) characterization of group emotions, preferences, appreciations; (5) social interaction research (two or more people), (6) arts, entertainment, games. We discuss some examples from multibrain computing and focus on possible ways of joint decision making (or otherwise using the measured brain activity of multiple users). We will also emphasize the possibilities that are offered by the multimodal context, that is, considering brain-computer interfacing as one of the many possible modalities to obtain information about a user's or a group of users' affective states, preferences, and decisions. How to fuse information coming from different modalities and from different users need to be discussed. For that, we can learn from multimodal interaction research in human-computer interaction, including observations on sequential and parallel multimodality.

KW - Brain-Computer Interfaces (BCI)

U2 - 10.1016/B978-0-12-811926-6.00056-7

DO - 10.1016/B978-0-12-811926-6.00056-7

M3 - Chapter

SN - 9780128119266

SP - 243

BT - Neuroergonomics: The Brain at Work and in Everyday Life

A2 - Ayaz, Hasan

A2 - Dehais, Frederic

PB - Elsevier

ER -

Nijholt A. Multi-Brain Computing: BCI Monitoring and Real-Time Decision Making. In Ayaz H, Dehais F, editors, Neuroergonomics: The Brain at Work and in Everyday Life. Elsevier. 2018. p. 243 https://doi.org/10.1016/B978-0-12-811926-6.00056-7