Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Differences in user responses to awizard-of-oz versus automated system

Thomason, J and Litman, D (2013) Differences in user responses to awizard-of-oz versus automated system. In: UNSPECIFIED.

[img] Plain Text (licence)
Available under License : See the attached license file.

Download (1kB)


Wizard-of-Oz experimental setup in a dialogue system is commonly used to gather data for informing an automated version of that system. Previous work has exposed dependencies between user behavior towards systems and user belief about whether the system is automated or human-controlled. This work examines whether user behavior changes when user belief is held constant and the system's operator is varied. We perform a posthoc experiment using generalizable prosodic and lexical features of user responses to a dialogue system backed with and without a human wizard. Our results suggest that user responses are different when communicating with a wizarded and an automated system, indicating that wizard data may be less reliable for informing automated systems than generally assumed.


Social Networking:
Share |


Item Type: Conference or Workshop Item (UNSPECIFIED)
Status: Published
CreatorsEmailPitt UsernameORCID
Thomason, J
Litman, Ddlitman@pitt.eduDLITMAN
Centers: Other Centers, Institutes, Offices, or Units > Learning Research & Development Center
Date: 1 January 2013
Date Type: Publication
Access Restriction: No restriction; Release the ETD for access worldwide immediately.
Journal or Publication Title: NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference
Page Range: 796 - 801
Event Type: Conference
Institution: University of Pittsburgh
Schools and Programs: Dietrich School of Arts and Sciences > Computer Science
Dietrich School of Arts and Sciences > Computer Science > Intelligent Systems Technical Reports
Refereed: Yes
ISBN: 9781937284473
Related URLs:
Date Deposited: 14 Aug 2014 15:46
Last Modified: 30 Mar 2021 12:56


Monthly Views for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item