The proliferation of brain-computer interface (BCI) technology promises locked-in patients potential ways to communicate successfully. Most BCI systems either involve selection from among a set of simultaneously presented stimuli, requiring extensive control of the interface;or use binary stimulus selection mechanisms that fail to achieve high communication rates because of slow intent detection or a fixed (context independent) ordering of stimuli. We propose a new interface using binary selection of text input via rapid serial visual presentation of natural language components. Individuals with severe speech and physical impairments (SSPI) resulting from acquired neurological disorders (amyotrophic lateral sclerosis, brainstem stroke, Parkinson's disease, multiple sclerosis, spinal cord injury) and neurodevelopmental disorders (cerebral palsy, muscular dystrophy) drive the proposed research. Four laboratories form an alliance for this translational research project: basic research (Erdogmus, engineering;Roark, computer science and natural language processing), and clinical research (Oken, neurology/neurophysiology;Fried-Oken, augmentative communication/neurogenic communication disorders).
Our aims are (1) to develop an innovative EEG-based BCI that achieves increased communication rates with fewer errors and greater satisfaction for the target SSPI populations;(2) to iteratively refine the system in the laboratory with user feedback from healthy subjects and expert LIS users of marketed AAC systems;(3) to evaluate the performance of the system within the natural clinical settings of SSPI patients. The innovative BCI is the RSVP Keyboard with three essential features: (1) rapid serial visual presentation (RSVP) of linguistic components ranging from letters to words to phrases;(2) a detection mechanism that employs multichannel electroencephalography (EEG) and/or other suitable response mechanisms that can reliably indicate the binary intent of the user and adapt based on individualized neurophysiologic data of the user;and (3) an open-vocabulary natural language model with a capability for accurate predictions of upcoming text. Theoretical framework is based on a solid Bayesian foundation;clinical usability is based on the WHO ICF (WHO, 2001) and an Augmentative and Alternative Communication (AAC) model of participation. Rigorous experimental scrutiny in both clinical laboratory and natural settings will be obtained with able-bodied subjects and SSPI patients. Measures of learning rate, speed of message production, error rate and user satisfaction for different iterations of the RSVP keyboard will be obtained using an hypothesis-driven crossover design for 36 healthy subjects, and alternating treatment randomization design for 40 patients with SSPI. Descriptions of the motor, cognitive, and language skills of LIS patients using the novel system in their natural environments will inform clinical guidelines and functional device adaptations to better individualize treatment for children and adults with SSPI. The collaborative nature of the proposed translational research is expected to yield new knowledge for both BCI development and clinical AAC use. Relevance: The populations of patients with locked-in syndrome are increasing as medical technologies advance and successfully support life. These individuals with limited to no movement could potentially contribute to their medical decision making, informed consent, and daily care giving if they had faster, more reliable means to interface with communication systems. The RSVP keyboard and proposed language models are innovative technological discoveries that are being applied to clinical augmentative communication tools so that patients and their families can participate in daily activities and advocate for improvements in standard clinical care. The proposed project stresses the translation of basic computer science into clinical care, supporting the proposed NIH Roadmap and public health initiatives.
The populations of patients with locked-in syndrome are increasing as medical technologies advance and successfully support life. These individuals with limited to no movement could potentially contribute to their medical decision making, informed consent, and daily care giving if they had faster, more reliable means to interface with communication systems. The RSVP keyboard and proposed language models are innovative technological discoveries that are being applied to clinical augmentative communication tools so that patients and their families can participate in daily activities and advocate for improvements in standard clinical care. The proposed project stresses the translation of basic computer science into clinical care, supporting the proposed NIH Roadmap and public health initiatives.
| Nezamfar, Hooman; Mohseni Salehi, Seyed Sadegh; Higger, Matt et al. (2018) Code-VEP vs. Eye Tracking: A Comparison Study. Brain Sci 8: |
| Gonzalez-Navarro, P; Moghadamfalahi, M; Akcakaya, M et al. (2017) Spatio-Temporal EEG Models for Brain Interfaces. Signal Processing 131:333-343 |
| Higger, Matt; Quivira, Fernando; Akcakaya, Murat et al. (2017) Recursive Bayesian Coding for BCIs. IEEE Trans Neural Syst Rehabil Eng 25:704-714 |
| Marghi, Yeganeh M; Farjadian, Amir B; Sheng-Che Yen et al. (2017) EEG-guided robotic mirror therapy system for lower limb rehabilitation. Conf Proc IEEE Eng Med Biol Soc 2017:1917-1921 |
| Haghighi, Marzieh; Moghadamfalahi, Mohammad; Akcakaya, Murat et al. (2017) A Graphical Model for Online Auditory Scene Modulation Using EEG Evidence for Attention. IEEE Trans Neural Syst Rehabil Eng 25:1970-1977 |
| Salehi, Seyed Sadegh Mohseni; Moghadamfalahi, Mohammad; Nezamfar, Hooman et al. (2017) Context-aware recursive bayesian graph traversal in BCIs. Conf Proc IEEE Eng Med Biol Soc 2017:2972-2975 |
| Mohseni Salehi, Seyed Sadegh; Moghadamfalahi, Mohammad; Quivira, Fernando et al. (2017) Decoding complex imagery hand gestures. Conf Proc IEEE Eng Med Biol Soc 2017:2968-2971 |
| Chavarriaga, Ricardo; Fried-Oken, Melanie; Kleih, Sonja et al. (2017) Heading for new shores! Overcoming pitfalls in BCI design. Brain Comput Interfaces (Abingdon) 4:60-73 |
| Frontera, Walter R; Bean, Jonathan F; Damiano, Diane et al. (2017) Rehabilitation Research at the National Institutes of Health:: Moving the Field Forward (Executive Summary). Phys Ther 97:393-403 |
| Andresen, Elena M; Fried-Oken, Melanie; Peters, Betts et al. (2016) Initial constructs for patient-centered outcome measures to evaluate brain-computer interfaces. Disabil Rehabil Assist Technol 11:548-57 |
Showing the most recent 10 out of 29 publications
