Incorporation of a language model into a brain computer interface based speller

Ulaş, Çağdaş (2013) Incorporation of a language model into a brain computer interface based speller. [Thesis]

[thumbnail of CagdasUlas_10014327.pdf] PDF

Download (1MB)


Brain computer interface (BCI) research deals with the problem of establishing direct communication pathways between the brain and external devices. The primary motivation is to enable patients with limited or no muscular control to use external devices by automatically interpreting their intent based on brain electrical activity, measured by, e.g., electroencephalography (EEG). The P300 speller is a widely practised BCI set up that involves having subjects type letters based on P300 signals generated by their brains in response to visual stimuli. Because of the low signal-to-noise ratio (SNR) and variability of EEG signals, existing typing systems use many repetitions of the visual stimuli in order to increase accuracy at the cost of speed. The main motivation for the work in this thesis comes from the observation that the prior information provided by both neighbouring and current letters within words in a particular language can assist letter estimation with the aim of developing a system that achieves higher accuracy and speed simultaneously. Based on this observation, in this thesis, we present an approach for incorporation of such information into a BCI-based speller through Hidden Markov Models (HMM) trained by a language model. We then describe filtering and smoothing algorithms in conjunction with n-gram language models for inference over such a model. We have designed data collection experiments for offline and online decision-making which demonstrate that incorporation of the language model in this manner results in significant improvements in letter estimation and typing speed.
Item Type: Thesis
Uncontrolled Keywords: Brain-computer interface. -- Electroencephalography. -- Hidden Markov Model. -- P300 speller. -- N-gram language modelling. -- Beyin-Bilgisayar Arayüzü. -- Elektroensefalografi. -- Saklı Markov Modeli. P300 heceleticisi. -- N-gram dil modeli.
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800-8360 Electronics
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Electronics
Faculty of Engineering and Natural Sciences
Depositing User: IC-Cataloging
Date Deposited: 08 Oct 2015 10:36
Last Modified: 26 Apr 2022 10:05

Actions (login required)

View Item
View Item