Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Reliability of brain-computer interface language sample transcription procedures

Hill, K and Kovacs, T and Shin, S (2014) Reliability of brain-computer interface language sample transcription procedures. Journal of Rehabilitation Research and Development, 51 (4). 579 - 590. ISSN 0748-7711

Published Version
Available under License : See the attached license file.

Download (512kB)
[img] Plain Text (licence)
Available under License : See the attached license file.

Download (1kB)


We tested the reliability of transcribing language samples of daily brain-computer interface (BCI) communication recorded as language activity monitoring (LAM) logfiles. This study determined interrater reliability and interjudgeagreement for transcription of communication of veterans with amyotrophic lateral sclerosis using a P300-based BCI as an augmentative and alternative communication (AAC) system. KeyLAM software recorded logfiles in a universal logfile format during use of BCI-controlled email and word processing applications. These logfiles were encrypted and sent to our laboratory for decryption, transcription, and analysis. The study reports reliability results on transcription of 345 daily logfile samples. The procedure was found to be accurate across transcribers/raters. Frequency of agreement ratios of 97.6% for total number of words and 93.5% for total utterances were found as measures of interrater reliability. Interjudge agreement was 100% for both measures. The results indicated that transcribing language samples using LAM data is highly reliable and the fidelity of the process can be maintained. LAM data supported the transcription of a large number of samples that could not have been completed using audio and video recordings of AAC speakers. This demonstrated efficiency of LAM tools to measure language performance benefits to BCI research and clinical communities.


Social Networking:
Share |


Item Type: Article
Status: Published
CreatorsEmailPitt UsernameORCID
Hill, Kkhill@pitt.eduKHILL
Kovacs, T
Shin, Ssas303@pitt.eduSAS303
Date: 1 January 2014
Date Type: Publication
Journal or Publication Title: Journal of Rehabilitation Research and Development
Volume: 51
Number: 4
Page Range: 579 - 590
DOI or Unique Handle: 10.1682/jrrd.2013.05.0102
Schools and Programs: School of Health and Rehabilitation Sciences > Rehabilitation Science
Refereed: Yes
ISSN: 0748-7711
Date Deposited: 22 May 2015 21:39
Last Modified: 23 Jan 2019 02:55


Monthly Views for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item