The promise of brain-computer interfaces (BCI) for communication is becoming a reality for individuals with severe speech and physical impairments (SSPI) who cannot rely on speech or writing to express themselves. While the majority of research efforts are devoted to technology development to address problems of stability, reliability and/or classification, clinical and behavioral challenges are becoming more apparent as individuals with SSPI and their family/care teams assess the systems during novice or long-term trials. The objective of the RSVP Keyboard(tm) BCI translational research team is to address the clinical challenges raised during functional BCI use with innovative engineering design, thereby enhancing the potential of this novel assistive technology.
Four specific aims are proposed: (1) to develop a BCI Communication Application Suite (BCI-CAS) that offers a set of language modules to people with SSPI that can meet their language/literacy skills; (2) to develop improved statistical signal models for personalized feature extraction, artifact/interference handling, and robust, accurate intent evidence extraction from physiologic signals; (3) to develop improved language models and stimulus sequence optimization methods; and (4) to evaluate cognitive variables that affect learning and performance of the BCI-CAS. Five language modules are proposed that rely on a multimodal evidence fusion framework for model-based context-aware optimal intent inference: RSVP Keyboard(tm) generative spelling; RSVP texting; RSVP in-context typing; RSVP in-context icon typing; and binary yes/no responses with SSVEPs. Usability data on the current RSVP Keyboard(tm) and SSVEP system drive all proposed aims. Users select a language module, and the BCI system optimizes performance for each individual based on user adaptation, intent inference, and personalized language modeling. A unique simulation function drives individualization of system parameters. The robustness of the BCI customization efforts are evaluated continually by adults with SSPI and neurotypical controls in an iterative fashion. The effect of three intervention programs that address the cognitive construct of attention (process-specific attention training, mindfulness meditation training and novel stimulus presentations) will be implemented through hypothesis-driven single subject designs. Thirty participants, ages 21 years and older with SSPI will be included in home-based interventions. By measuring information transfer rate (ITR), user satisfaction, and intrinsic user factors, we will identify learning strategies that influence BCI sill acquisition and performance for adults with neurodegenerative or neurodevelopmental conditions. The translational teams include (1) signal processing (Erdogmus); (2) clinical neurophysiology (Oken); (3) natural language processing (Bedrick/Gorman); and (4) assistive technology (Fried-Oken). We continue to rely on a solid Bayesian foundation and theoretical frameworks: ICF disability classification (WHO, 2001), the AAC model of participation (Beukelman & Mirenda, 2013) and the Matching Person to Technology Model (Scherer, 2002).

Public Health Relevance

The populations of patients with severe speech and physical impairments secondary to neurodevelopmental and neurodegenerative diseases are increasing as medical technologies advance and successfully support life. These individuals with limited to no movement could potentially contribute to their medical decision making, informed consent, and daily caregiving if they had faster, more reliable means to interface with communication systems. The BCI Communication Applications Suite is a hybrid brain-computer interface that is an innovative technological advance so that patients and their families can participate in daily activities and advocate for improvements in standard clinical care. The proposed project stresses the translation of basic computer science into clinical care, supporting the proposed NIH Roadmap and public health initiatives.

Agency
National Institute of Health (NIH)
Institute
National Institute on Deafness and Other Communication Disorders (NIDCD)
Type
Research Project (R01)
Project #
5R01DC009834-09
Application #
9432500
Study Section
Special Emphasis Panel (ZDC1)
Program Officer
Shekim, Lana O
Project Start
2009-02-01
Project End
2020-02-29
Budget Start
2018-03-01
Budget End
2019-02-28
Support Year
9
Fiscal Year
2018
Total Cost
Indirect Cost
Name
Oregon Health and Science University
Department
Internal Medicine/Medicine
Type
Schools of Medicine
DUNS #
096997515
City
Portland
State
OR
Country
United States
Zip Code
97239
Nezamfar, Hooman; Mohseni Salehi, Seyed Sadegh; Higger, Matt et al. (2018) Code-VEP vs. Eye Tracking: A Comparison Study. Brain Sci 8:
Chavarriaga, Ricardo; Fried-Oken, Melanie; Kleih, Sonja et al. (2017) Heading for new shores! Overcoming pitfalls in BCI design. Brain Comput Interfaces (Abingdon) 4:60-73
Frontera, Walter R; Bean, Jonathan F; Damiano, Diane et al. (2017) Rehabilitation Research at the National Institutes of Health:: Moving the Field Forward (Executive Summary). Phys Ther 97:393-403
Gonzalez-Navarro, P; Moghadamfalahi, M; Akcakaya, M et al. (2017) Spatio-Temporal EEG Models for Brain Interfaces. Signal Processing 131:333-343
Higger, Matt; Quivira, Fernando; Akcakaya, Murat et al. (2017) Recursive Bayesian Coding for BCIs. IEEE Trans Neural Syst Rehabil Eng 25:704-714
Marghi, Yeganeh M; Farjadian, Amir B; Sheng-Che Yen et al. (2017) EEG-guided robotic mirror therapy system for lower limb rehabilitation. Conf Proc IEEE Eng Med Biol Soc 2017:1917-1921
Haghighi, Marzieh; Moghadamfalahi, Mohammad; Akcakaya, Murat et al. (2017) A Graphical Model for Online Auditory Scene Modulation Using EEG Evidence for Attention. IEEE Trans Neural Syst Rehabil Eng 25:1970-1977
Salehi, Seyed Sadegh Mohseni; Moghadamfalahi, Mohammad; Nezamfar, Hooman et al. (2017) Context-aware recursive bayesian graph traversal in BCIs. Conf Proc IEEE Eng Med Biol Soc 2017:2972-2975
Mohseni Salehi, Seyed Sadegh; Moghadamfalahi, Mohammad; Quivira, Fernando et al. (2017) Decoding complex imagery hand gestures. Conf Proc IEEE Eng Med Biol Soc 2017:2968-2971
Andresen, Elena M; Fried-Oken, Melanie; Peters, Betts et al. (2016) Initial constructs for patient-centered outcome measures to evaluate brain-computer interfaces. Disabil Rehabil Assist Technol 11:548-57

Showing the most recent 10 out of 29 publications