Multimodal and Multi-Brain Computer Interfaces: A Review

In this short paper we survey recent research views in non-traditional brain-computer interfaces. That is, interfaces that can process brain activity input, but that are designed for non-clinical purposes, that are meant to be used by ‘healthy’ users, that process other user input as well, and that even allow input, voluntarily or involuntarily, from multiple users. This is a rather new research and BCI application area. Control of applications can be made more robust by fusing brain activity information with other information, either explicitly provided by a user (such as commands) or extracted from the user by interpreting his or her behavior (movements, posture, gaze, facial expression, nonverbal speech) or sensing (neuro-)physiological characteristics (skin conductivity, heart rate, brain activity). We see also research where brain activity of multiple users is fused to get a (sometimes critical) control task done. We see also the emergence of applications where BCI measurements help to improve group performance, for example, during meetings, or where information obtained from these measurements helps to learn about audience preferences. Multi-brain BCI has also become a paradigm in artistic and game applications. Artistic interactive BCI applications may require audience participation. In game environments brain activity of various players can be used to control or adapt the game. Both competition and collaboration in serious games, entertainment games and artistic installations requires fusion of EEG measurements from different subjects.