Brain-computer interface technology: a review of the first international meeting.

Over the past decade, many laboratories have begun to explore brain-computer interface (BCI) technology as a radically new communication option for those with neuromuscular impairments that prevent them from using conventional augmentative communication methods. BCI's provide these users with communication channels that do not depend on peripheral nerves and muscles. This article summarizes the first international meeting devoted to BCI research and development. Current BCI's use electroencephalographic (EEG) activity recorded at the scalp or single-unit activity recorded from within cortex to control cursor movement, select letters or icons, or operate a neuroprosthesis. The central element in each BCI is a translation algorithm that converts electrophysiological input from the user into output that controls external devices. BCI operation depends on effective interaction between two adaptive controllers, the user who encodes his or her commands in the electrophysiological input provided to the BCI, and the BCI which recognizes the commands contained in the input and expresses them in device control. Current BCI's have maximum information transfer rates of 5-25 b/min. Achievement of greater speed and accuracy depends on improvements in signal processing, translation algorithms, and user training. These improvements depend on increased interdisciplinary cooperation between neuroscientists, engineers, computer programmers, psychologists, and rehabilitation specialists, and on adoption and widespread application of objective methods for evaluating alternative methods. The practical use of BCI technology depends on the development of appropriate applications, identification of appropriate user groups, and careful attention to the needs and desires of individual users. BCI research and development will also benefit from greater emphasis on peer-reviewed publications, and from adoption of standard venues for presentations and discussion.     

The Wadsworth BCI Research and Development Program: at home with BCI.

The ultimate goal of brain-computer interface (BCI) technology is to provide communication and control capacities to people with severe motor disabilities. BCI research at the Wadsworth Center focuses primarily on noninvasive, electroencephalography (EEG)-based BCI methods. We have shown that people, including those with severe motor disabilities, can learn to use sensorimotor rhythms (SMRs) to move a cursor rapidly and accurately in one or two dimensions. We have also improved P300-based BCI operation. We are now translating this laboratory-proven BCI technology into a system that can be used by severely disabled people in their homes with minimal ongoing technical oversight. To accomplish this, we have: improved our general-purpose BCI software (BCI2000); improved online adaptation and feature translation for SMR-based BCI operation; improved the accuracy and bandwidth of P300-based BCI operation; reduced the complexity of system hardware and software and begun to evaluate home system use in appropriate users. These developments have resulted in prototype systems for every day use in people's homes.     

Multi‐command SSAEP‐based BCI system with training sessions for SSVEP during an eye fatigue state

This paper proposes a steady‐state auditory stimulus modality and a detection algorithm to replace steady‐state visual evoked potential (SSVEP )‐based brain–computer interface (BCI ) systems during visual fatigue periods. The optimal speaker position for the steady‐state auditory evoked potential (SSAEP )‐based BCI system and possible electrode positions are investigated. Using the proposed system, an accuracy of 85% for two commands was achieved based on the T3–T5 and T4–T6 electrode positions using only one speaker. SSAEP is a promising BCI modality for mitigating the problem of eye fatigue that often occurs during the use of SSVEP ‐based BCI systems. However, SSAEP ‐based BCI systems suffer from low accuracy. To increase accuracy, we propose a new enhanced SSAEP training method. The training process was enhanced by instructing users to control their attention levels while simultaneously detecting an auditory stimulus frequency. Furthermore, we propose a corresponding single‐frequency, multi‐command BCI paradigm for the proposed training method. With the proposed paradigm, four commands can be detected using only one auditory stimulus frequency. The proposed training system yielded an accuracy of ∼81% compared to 66% for sessions performed without the proposed training method. © 2017 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.     

脑电BCI系统的软硬件开发平台发展现状

脑-机接口系统(brain-computer interface,BCI)是一种将大脑活动信息直接转换为人工输出的系统,允许用户通过思维 活动直接控制外部设备。 脑电图技术(electroencephalogram,EEG)可以实时获取大脑活动产生的神经生理电信息,具有无创、低 廉、高时间分辨率等优点,是 BCI 获取大脑活动信息的主流方式之一。 脑电 BCI 系统具有脑电信号采集、处理和输出结果的功 能,能够诱发特征脑电,并控制外部设备,在康复、医疗诊断和神经科学研究等领域具有巨大的应用价值。 随着脑电 BCI 系统应 用需求不断增加,确保其快速高效地部署和应用的技术越来越重要。 结合近些年脑电 BCI 系统研究和应用,综合论述目前用于 开发脑电采集和编解码的硬件和软件平台的技术,分析归纳其当前现状与未来趋势,以促进开发脑电 BCI 系统软硬件平台的有 效发展。     

ECoG factors underlying multimodal control of a brain-computer interface.

Most current brain-computer interface (BCI) systems for humans use electroencephalographic activity recorded from the scalp, and may be limited in many ways. Electrocorticography (ECoG) is believed to be a minimally-invasive alternative to electroencephalogram (EEG) for BCI systems, yielding superior signal characteristics that could allow rapid user training and faster communication rates. In addition, our preliminary results suggest that brain regions other than the sensorimotor cortex, such as auditory cortex, may be trained to control a BCI system using similar methods as those used to train motor regions of the brain. This could prove to be vital for users who have neurological disease, head trauma, or other conditions precluding the use of sensorimotor cortex for BCI control.     

Towards human BCI applications based on cognitive brain systems: an investigation of neural signals recorded from the dorsolateral prefrontal cortex.

One of the critical issues in brain-computer interface (BCI) research is how to translate a person's intention into brain signals for controlling computer programs. The motor system is currently the primary focus, where signals are obtained during imagined motor responses. However, cognitive brain systems are also attractive candidates, in that they may be more amenable to conscious control, yielding better regulation of magnitude and duration of localized brain activity. We report on a proof of principle study for the potential use of a higher cognitive system for BCI, namely the working memory (WM) system. We show that mental calculation reliably activates the WM network as measured with functional magnetic resonance imaging (fMRI). Moreover, activity in the dorsolateral prefrontal cortex (DLPFC) indicates that this region is active for the duration of mental processing. This supports the notion that DLPFC can be activated, and remains active, at will. Further confirmation is obtained from a patient with an implanted electrode grid for diagnostic purposes, in that gamma power within DLPFC increases during mental calculation and remains elevated for the duration thereof. These results indicate that cortical regions involved in higher cognitive functions may serve as a readily self-controllable input for BCI applications. It also shows that fMRI is an effective tool for identifying function-specific foci in individual subjects for subsequent placement of cortical electrodes. The fact that electrocorticographic (ECoG) signal confirmed the functional localization of fMRI provides a strong argument for incorporating fMRI in BCI research.     

The Neurochip BCI: towards a neural prosthesis for upper limb function.

The Neurochip BCI is an autonomously operating interface between an implanted computer chip and recording and stimulating electrodes in the nervous system. By converting neural activity recorded in one brain area into electrical stimuli delivered to another site, the Neurochip BCI could form the basis for a simple, direct neural prosthetic. In tests with normal, unrestrained monkeys, the Neurochip continuously recorded activity of single neurons in primary motor cortex for several weeks at a time. Cortical activity was correlated with simultaneously-recorded electromyogram (EMG) activity from arm muscles during free behavior. In separate experiments with anesthetized monkeys, we found that microstimulation of the cervical spinal cord evoked movements of the arm and hand, often involving multiple muscles synergies. These observations suggest that spinal microstimulation controlled by cortical neurons could help compensate for damaged corticospinal projections.     

Towards a robust BCI: error potentials and online learning.

Recent advances in the field of brain-computer interfaces (BCIs) have shown that BCIs have the potential to provide a powerful new channel of communication, completely independent of muscular and nervous systems. However, while there have been successful laboratory demonstrations, there are still issues that need to be addressed before BCIs can be used by nonexperts outside the laboratory. At IDIAP Research Institute, we have been investigating several areas that we believe will allow us to improve the robustness, flexibility, and reliability of BCIs. One area is recognition of cognitive error states, that is, identifying errors through the brain's reaction to mistakes. The production of these error potentials (ErrP) in reaction to an error made by the user is well established. We have extended this work by identifying a similar but distinct ErrP that is generated in response to an error made by the interface, (a misinterpretation of a command that the user has given). This ErrP can be satisfactorily identified in single trials and can be demonstrated to improve the theoretical performance of a BCI. A second area of research is online adaptation of the classifier. BCI signals change over time, both between sessions and within a single session, due to a number of factors. This means that a classifier trained on data from a previous session will probably not be optimal for a new session. In this paper, we present preliminary results from our investigations into supervised online learning that can be applied in the initial training phase. We also discuss the future direction of this research, including the combination of these two currently separate issues to create a potentially very powerful BCI.     

Continuous EEG classification during motor imagery-simulation of an asynchronous BCI

Nearly all electroencephalogram (EEG)-based brain-computer interface (BCI) systems operate in a cue-paced or synchronous mode. This means that the onset of mental activity (thought) is externally-paced and the EEG has to be analyzed in predefined time windows. In the near future, BCI systems that allow the user to intend a specific mental pattern whenever she/he wishes to produce such patterns will also become important. An asynchronous BCI is characterized by continuous analyzing and classification of EEG data. Therefore, it is important to maximize the hits (true positive rate) during an intended mental task and to minimize the false positive detections in the resting or idling state. EEG data recorded during right/left motor imagery is used to simulate an asynchronous BCI. To optimize the classification results, a refractory period and a dwell time are introduced.     

ERPs evoked by different matrix sizes: implications for a brain computer interface (BCI) system

A brain-computer interface (BCI) system may allow a user to communicate by selecting one of many options. These options may be presented in a matrix. Larger matrices allow a larger vocabulary, but require more time for each selection. In this study, subjects were asked to perform a target detection task using matrices appropriate for a BCI. The study sought to explore the relationship between matrix size and EEG measures, target detection accuracy, and user preferences. Results indicated that larger matrices evoked a larger P300 amplitude, and that matrix size did not significantly affect performance or preferences.     

Rapid prototyping of an EEG-based brain-computer interface (BCI)

The electroencephalogram (EEG) is modified by motor imagery and can be used by patients with severe motor impairments (e.g., late stage of amyotrophic lateral sclerosis) to communicate with their environment. Such a direct connection between the brain and the computer is known as an EEG-based brain-computer interface (BCI). This paper describes a new type of BCI system that uses rapid prototyping to enable a fast transition of various types of parameter estimation and classification algorithms to real-time implementation and testing. Rapid prototyping is possible by using Matlab, Simulink, and the Real-Time Workshop. It is shown how to automate real-time experiments and perform the interplay between on-line experiments and offline analysis. The system is able to process multiple EEG channels on-line and operates under Windows 95 in real-time on a standard PC without an additional DSP board. The BCI can be controlled over the Internet, LAN or modem. This BCI was tested on 3 subjects whose task it was to imagine either left or right hand movement. A classification accuracy between 70% and 95% could be achieved with two EEG channels after some sessions with feedback using an adaptive autoregressive model and linear discriminant analysis     

BCI Meeting 2005--workshop on signals and recording methods.

This paper describes the highlights of presentations and discussions during the Third International BCI Meeting in a workshop that evaluated potential brain-computer interface (BCI) signals and currently available recording methods. It defined the main potential user populations and their needs, addressed the relative advantages and disadvantages of noninvasive and implanted (i.e., invasive) methodologies, considered ethical issues, and focused on the challenges involved in translating BCI systems from the laboratory to widespread clinical use. The workshop stressed the critical importance of developing useful applications that establish the practical value of BCI technology.     

Conversion of EEG activity into cursor movement by a brain-computer interface (BCI)

The Wadsworth electroencephalogram (EEG)-based brain-computer interface (BCI) uses amplitude in mu or beta frequency bands over sensorimotor cortex to control cursor movement. Trained users can move the cursor in one or two dimensions. The primary goal of this research is to provide a new communication and control option for people with severe motor disabilities. Currently, cursor movements in each dimension are determined 10 times/s by an empirically derived linear function of one or two EEG features (i.e., spectral bands from different electrode locations). This study used offline analysis of data collected during system operation to explore methods for improving the accuracy of cursor movement. The data were gathered while users selected among three possible targets by controlling vertical [i.e., one-dimensional (1-D)] cursor movement. The three methods analyzed differ in the dimensionality of the cursor movement [1-D versus two-dimensional (2-D)] and in the type of the underlying function (linear versus nonlinear). We addressed two questions: Which method is best for classification (i.e., to determine from the EEG which target the user wants to hit)? How does the number of EEG features affect the performance of each method? All methods reached their optimal performance with 10-20 features. In offline simulation, the 2-D linear method and the 1-D nonlinear method improved performance significantly over the 1-D linear method. The 1-D linear method did not do so. These offline results suggest that the 1-D nonlinear or the 2-D linear cursor function will improve online operation of the BCI system.     

BCI Meeting 2005--workshop on BCI signal processing: feature extraction and translation.

This paper describes the outcome of discussions held during the Third International BCI Meeting at a workshop charged with reviewing and evaluating the current state of and issues relevant to brain-computer interface (BCI) feature extraction and translation. The issues discussed include a taxonomy of methods and applications, time-frequency spatial analysis, optimization schemes, the role of insight in analysis, adaptation, and methods for quantifying BCI feedback.     

A minimal set of electrodes for motor imagery BCI to control an assistive device in chronic stroke subjects: a multi-session study

The brain-computer interface (BCI) system has been developed to assist people with motor disability. To make the system more user-friendly, it is a challenge to reduce the electrode preparation time and have a good reliability. This study aims to find a minimal set of electrodes for an individual stroke subject for motor imagery to control an assistive device using functional electrical stimulation for 20 sessions with accuracy higher than 90%. The characteristics of this minimal electrode set were evaluated with two popular algorithms: Fisher's criterion and support-vector machine recursive feature elimination (SVM-RFE). The number of calibration sessions for channel selection required for robust control of these 20 sessions was also investigated. Five chronic stroke patients were recruited for the study. Our results suggested that the number of calibration sessions for channel selection did not have a significant effect on the classification accuracy. A performance index devised in this study showed that one training day with 12 electrodes using the SVM-RFE method achieved the best balance between the number of electrodes and accuracy in the 20-session data. Generally, 8-36 channels were required to maintain accuracy higher than 90% in 20 BCI training sessions for chronic stroke patients.     

Parallel man-machine training in development of EEG-based cursor control.

A new parallel man-machine training approach to brain-computer interface (BCI) succeeded through a unique application of machine learning methods. The BCI system could train users to control an animated cursor on the computer screen by voluntary electroencephalogram (EEG) modulation. Our BCI system requires only two to four electrodes, and has a relatively short training time for both the user and the machine. Moving the cursor in one dimension, our subjects were able to hit 100% of randomly selected targets, while in two dimensions, accuracies of approximately 63% and 76% was achieved with our two subjects.     

结合表面肌电与稳态视觉诱发电位的混合脑机接口关键技术研究

脑-机接口技术旨在大脑与外部环境之间建立一种全新的不依赖于外周神经和肌肉的交流与控制通道。基于稳态视觉诱发电位的脑-机接口是目前信息传输率最高的无创脑 机接口范式，但是仍低于传统的交互方式。提出一种结合表面肌电与稳态视觉诱发电位的混合脑 机接口，以进一步提高系统的信息传输率。通过不同频率的高频稳态视觉诱发电位结合sEMG编码，实现二者混合脑 机接口系统。利用典型相关分析方法对SSVEP信号进行频率识别，sEMG的检测则采用频域分析方法。来自8名健康受试者的离线结果表明该系统能够获得8428% 的平均准确率，平均信息传输率为7263 bits/min。这些结果为结合表面肌电与稳态视觉诱发电位的混合脑 机接口研究奠定了基础。     

An adaptive P300-based online brain-computer interface.

The P300 component of an event related potential is widely used in conjunction with brain-computer interfaces (BCIs) to translate the subjects intent by mere thoughts into commands to control artificial devices. A well known application is the spelling of words while selection of the letters is carried out by focusing attention to the target letter. In this paper, we present a P300-based online BCI which reaches very competitive performance in terms of information transfer rates. In addition, we propose an online method that optimizes information transfer rates and/or accuracies. This is achieved by an algorithm which dynamically limits the number of subtrial presentations, according to the subject's current online performance in real-time. We present results of two studies based on 19 different healthy subjects in total who participated in our experiments (seven subjects in the first and 12 subjects in the second one). In the first, study peak information transfer rates up to 92 bits/min with an accuracy of 100% were achieved by one subject with a mean of 32 bits/min at about 80% accuracy. The second experiment employed a dynamic classifier which enables the user to optimize bitrates and/or accuracies by limiting the number of subtrial presentations according to the current online performance of the subject. At the fastest setting, mean information transfer rates could be improved to 50.61 bits/min (i.e., 13.13 symbols/min). The most accurate results with 87.5% accuracy showed a transfer rate of 29.35 bits/min.     

The impact of loss of control on movement BCIs

Brain-computer interfaces (BCIs) are known to suffer from spontaneous changes in the brain activity. If changes in the mental state of the user are reflected in the brain signals used for control, the behavior of a BCI is directly influenced by these states. We investigate the influence of a state of loss of control in a variant of Pacman on the performance of BCIs based on motor control. To study the effect a temporal loss of control has on the BCI performance, BCI classifiers were trained on electroencephalography (EEG) recorded during the normal control condition, and the classification performance on segments of EEG from the normal and loss of control condition was compared. Classifiers based on event-related desynchronization unexpectedly performed significantly better during the loss of control condition; for the event-related potential classifiers there was no significant difference in performance.     

P300-based BCI mouse with genetically-optimized analogue control.

In this paper we propose a brain-computer interface (BCI) mouse based on P300 waves in electroencephalogram (EEG) signals. The system is analogue in that at no point a binary decision is made as to whether or not a P300 was actually produced in response to the stimuli. Instead, the 2-D motion of the pointer on the screen, using a novel BCI paradigm, is controlled by directly combining the amplitudes of the output produced by a filter in the presence of different stimuli. This filter and the features to be combined within it are optimised by an evolutionary algorithm.