Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Designing and evaluating a wizarded uncertainty-adaptive spoken dialogue tutoring system

Forbes-Riley, K and Litman, D (2011) Designing and evaluating a wizarded uncertainty-adaptive spoken dialogue tutoring system. Computer Speech and Language, 25 (1). 105 - 126. ISSN 0885-2308

[img] Plain Text (licence)
Available under License : See the attached license file.

Download (1kB)

Abstract

We describe the design and evaluation of two different dynamic student uncertainty adaptations in wizarded versions of a spoken dialogue tutoring system. The two adaptive systems adapt to each student turn based on its uncertainty, after an unseen human "wizard" performs speech recognition and natural language understanding and annotates the turn for uncertainty. The design of our two uncertainty adaptations is based on a hypothesis in the literature that uncertainty is an "opportunity to learn"; both adaptations use additional substantive content to respond to uncertain turns, but the two adaptations vary in the complexity of these responses. The evaluation of our two uncertainty adaptations represents one of the first controlled experiments to investigate whether substantive dynamic responses to student affect can significantly improve performance in computer tutors. To our knowledge we are the first study to show that dynamically responding to uncertainty can significantly improve learning during computer tutoring. We also highlight our ongoing evaluation of our uncertainty-adaptive systems with respect to other important performance metrics, and we discuss how our corpus can be used by the wider computer speech and language community as a linguistic resource supporting further research on effective affect-adaptive spoken dialogue systems in general. © 2009 Elsevier Ltd.


Share

Citation/Export:
Social Networking:
Share |

Details

Item Type: Article
Status: Published
Creators/Authors:
CreatorsEmailPitt UsernameORCID
Forbes-Riley, K
Litman, Ddlitman@pitt.eduDLITMAN
Centers: Other Centers, Institutes, Offices, or Units > Learning Research & Development Center
Date: 1 January 2011
Date Type: Publication
Journal or Publication Title: Computer Speech and Language
Volume: 25
Number: 1
Page Range: 105 - 126
DOI or Unique Handle: 10.1016/j.csl.2009.12.002
Schools and Programs: Dietrich School of Arts and Sciences > Computer Science
Dietrich School of Arts and Sciences > Intelligent Systems
Refereed: Yes
ISSN: 0885-2308
Date Deposited: 30 Jul 2014 20:39
Last Modified: 02 Feb 2019 15:59
URI: http://d-scholarship.pitt.edu/id/eprint/22560

Metrics

Monthly Views for the past 3 years

Plum Analytics

Altmetric.com


Actions (login required)

View Item View Item