Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

A simulation study of computer-adaptive testing for measuring treatment-related change in confrontation naming

Bayotas, Pauline Wanda (2022) A simulation study of computer-adaptive testing for measuring treatment-related change in confrontation naming. Undergraduate Thesis, University of Pittsburgh. (Unpublished)

[img]
Preview
PDF
Download (404kB) | Preview

Abstract

Computer adaptive testing (CAT) is an approach that can be used to shorten assessments without sacrificing their psychometric properties. Recent studies (Fergadiotis, Kellough, & Hula, 2015; Hula, Kellough, & Fergadiotis, 2015; Fergadiotis, Hula, Swiderski, Lei, and Kellough, 2019; Hula, Fergadiotis, Swiderski, Silkes, & Kellough, 2020) produced a CAT with an item bank consisting of the Philadelphia Naming Test (PNT; Roach et al., 1996). The main advantage of CAT is to maximize the precision of the test, requiring fewer testing items while having the same or better level of accuracy as traditional brief naming assessments. However, before a CAT can be used to measure change in anomia severity, it is important to understand how the algorithm interacts with commonly used aphasia interventions and whether it is as responsive to treatment-related change as standard static assessments. This simulation study investigated the sensitivity of a computer adaptive version of the Philadelphia Naming Test (PNT-CAT) to treatment-related change in three different treatment conditions: item-general, item-specific and partially item-specific. For each condition, we simulated responses using a one-parameter logistic item response theory model and computed pre- to post-treatment change scores for the PNT-CAT and the full PNT. For the item-general condition, both tests performed similarly well. However, the PNT-CAT overestimated the effects of item-specific and the partially item-specific treatment relative to the full test. These results provide useful information about the conditions in which CAT can be validly used to measure treatment outcomes. Present results suggest that when treatment affects underlying naming ability the PNT-CAT30 is appropriately responsive to treatment and provides an efficient alternative to the administration to the full PNT. On the other hand, when treatment effects are item-specific, the PNT-CAT30 may overestimate or underestimate treatment effects depending on the baseline ability level and the number of treated items included in post-treatment CAT.


Share

Citation/Export:
Social Networking:
Share |

Details

Item Type: University of Pittsburgh ETD
Status: Unpublished
Creators/Authors:
CreatorsEmailPitt UsernameORCID
Bayotas, Pauline Wandapwb8@pitt.edupwb8
ETD Committee:
TitleMemberEmail AddressPitt UsernameORCID
Thesis AdvisorHula, William Dvorakwilliam.hula@med.va.gov
Committee ChairFergadiotis, Gerasimosgfergadiotis@pdx.edu
Committee ChairDickey, Michael Walshmdickey@pitt.edu
Committee ChairWallace, Sarahkmb326@pitt.edu
Date: 23 April 2022
Date Type: Publication
Defense Date: 30 March 2022
Approval Date: 23 April 2022
Submission Date: 20 April 2022
Access Restriction: No restriction; Release the ETD for access worldwide immediately.
Number of Pages: 42
Institution: University of Pittsburgh
Schools and Programs: David C. Frederick Honors College
School of Health and Rehabilitation Sciences > Communication Science and Disorders
Degree: BPhil - Bachelor of Philosophy
Thesis Type: Undergraduate Thesis
Refereed: Yes
Uncontrolled Keywords: aphasia, computer adaptive, simulation
Date Deposited: 23 Apr 2022 19:07
Last Modified: 23 Apr 2022 19:07
URI: http://d-scholarship.pitt.edu/id/eprint/42632

Metrics

Monthly Views for the past 3 years

Plum Analytics


Actions (login required)

View Item View Item