Li, Qi
(2024)
Long-term Stability, Test-Retest Reliability, and Lexical Properties of Core Nouns from Novel Discourse Stimuli.
Master's Thesis, University of Pittsburgh.
(Unpublished)
Abstract
Background: Core Lexicon Analysis (CLA) measures the use of keywords normed against the neurologically intact population during discourse. It is a promising tool to evaluate and monitor discourse production for people with aphasia (PWA), because it requires little transcription and training, and has been shown to have good interrater reliability and concurrent validity (Kim & Wright, 2020b). However, there are no studies on its test-retest reliability.
Aims: This study aims to investigate the test-retest reliability of CLA, specifically for core nouns, for a set of novel discourse stimuli. We also aimed to explore the effect of sample length on the test-retest reliability of CLA and characterize the phonological and semantic properties of the core nouns.
Methods & Procedures: Thirty-one non-brain damaged (NBD) community dwelling adults produced discourse in picture description and narrative storytelling tasks using novel visual stimuli. Fifteen participants saw discourse stimuli again after a mean of 149. Core noun lists, core noun scores, parameters related to test-retest reliability such as intraclass correlation coefficients (ICCs) and standard errors of measurement (SEMs), and sample lengths (defined as speaking durations) were obtained. Lexical properties of core nouns were extracted from corpus databases and normative studies (Balota et al., 2007; Fergadiotis et al., 2019; McRae et al., 2005; Johns, 2021).
Result: The ICCs for this set of stimuli ranged from –0.517 (95% Confidence Level [CI]: –0.875 to 0.033) to 0.695 (95% CI: [0.292, 0.887]), which are classified as “poor to moderate” according to Koo & Li (2016). Consistent with the ICCs, the group percent agreements ranged from 0 and 0.8, indicating considerable variability over time. Spearman’s ρ between sample lengths and ICCs for individuals ranged from 0.14 to 0.72, indicating a small to moderate positive correlation between the two variables.
Conclusions: We conducted the first study on the test-retest reliability of CLA. Under our experimental conditions, the test-retest reliability of core nouns for picture description and story narrative tasks was poor, though it seems to increase slightly as discourse duration increases.
Share
| Citation/Export: |
|
| Social Networking: |
|
Details
| Item Type: |
University of Pittsburgh ETD
|
| Status: |
Unpublished |
| Creators/Authors: |
|
| ETD Committee: |
|
| Date: |
6 June 2024 |
| Date Type: |
Publication |
| Defense Date: |
23 February 2024 |
| Approval Date: |
6 June 2024 |
| Submission Date: |
30 March 2024 |
| Access Restriction: |
No restriction; Release the ETD for access worldwide immediately. |
| Number of Pages: |
95 |
| Institution: |
University of Pittsburgh |
| Schools and Programs: |
School of Health and Rehabilitation Sciences > Communication Science and Disorders |
| Degree: |
MS - Master of Science |
| Thesis Type: |
Master's Thesis |
| Refereed: |
Yes |
| Uncontrolled Keywords: |
discourse analysis; core lexicon analysis; test-retest reliability; intraclass correlation coefficient |
| Related URLs: |
|
| Date Deposited: |
06 Jun 2024 13:58 |
| Last Modified: |
06 Jun 2024 13:58 |
| URI: |
http://d-scholarship.pitt.edu/id/eprint/45934 |
Metrics
Monthly Views for the past 3 years
Plum Analytics
Actions (login required)
 |
View Item |
![[feed]](/images/feed-icon-32x32.png){kind=icon}