Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Usability and Reliability of Autism Diagnostic Observation Schedule (ADOS) Module 4 Remote Administration

Schutte, Jamie (2013) Usability and Reliability of Autism Diagnostic Observation Schedule (ADOS) Module 4 Remote Administration. Doctoral Dissertation, University of Pittsburgh. (Unpublished)

Primary Text

Download (2MB) | Preview


Autism Spectrum Disorder (ASD) is characterized by impairments in social interaction, impairments in communication, and restricted repetitive and stereotyped patterns of behavior, interests, and activities. The Autism Diagnostic Observation Schedule (ADOS) Module 4 is a semi-structured diagnostic assessment tool designed for verbally fluent adolescents and adults with possible ASD. Due to a lack of available clinical expertise, it can be difficult for adults to receive an accurate ASD diagnostic assessment, especially those residing in rural areas. An ADOS teleassessment system was developed using the Versatile and Integrated System for Telerehabilitation (VISYTER). VISYTER consists of computer stations at the client site and clinician site, and a web portal server for managing and coordinating all elements of the assessment process. Clinician usability and fidelity to standard, face-to-face administration, was assessed. After improvements to the system were made, a study was conducted to determine the reliability of the ADOS module 4 administrations delivered remotely. Twenty-three adults with an ASD diagnosis participated in a within-subject crossover design study in which both a remote and face-to-face ADOS were administered. Weighted kappa was calculated for all 31 ADOS items. There was substantial agreement on 11 items and almost perfect or perfect agreement on 10 items. Intraclass correlations (ICCs) were calculated for algorithm subtotals. ICCs were greater than .75 for three out of four subtotals. There was substantial agreement on ADOS classification (i.e., diagnosis) between assessments delivered face-to-face versus assessments delivered remotely, Po=83%; ĸ =.772, ICC=.92. Non-agreement may have been due to outside factors or practice effect despite a washout period. Finally, usability and satisfaction of the remote assessment system was evaluated from the participants’ perspectives. Participant satisfaction with the remote ADOS delivery system was high. The results of these studies demonstrate that an ASD assessment designed to be delivered face-to-face can be reliably administered remotely using an integrated web-based system.


Social Networking:
Share |


Item Type: University of Pittsburgh ETD
Status: Unpublished
CreatorsEmailPitt UsernameORCID
Schutte, Jamiejcs85@pitt.eduJCS85
ETD Committee:
TitleMemberEmail AddressPitt UsernameORCID
Committee ChairMcCue, Michaelmmccue@pitt.eduMMCCUE
Committee MemberHanden, Benjaminhandenbl@upmc.eduBHANDEN
Committee MemberLewis, Allenalewis1@pitt.eduALEWIS1
Committee MemberMcGonigle, JohnMcGonigleJJ@upmc.eduJJM9
Committee MemberParmanto, Bambangparmanto@pitt.eduPARMANTO
Date: 22 January 2013
Date Type: Publication
Defense Date: 5 December 2012
Approval Date: 22 January 2013
Submission Date: 11 December 2012
Access Restriction: No restriction; Release the ETD for access worldwide immediately.
Number of Pages: 191
Institution: University of Pittsburgh
Schools and Programs: School of Health and Rehabilitation Sciences > Rehabilitation Science
Degree: PhD - Doctor of Philosophy
Thesis Type: Doctoral Dissertation
Refereed: Yes
Uncontrolled Keywords: Autism, Telerehabilitation, Assessment, Adults, Reliability, Usability
Date Deposited: 22 Jan 2013 15:01
Last Modified: 19 Dec 2016 14:40


Monthly Views for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item