Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Recognizing student emotions and attitudes on the basis of utterances in spoken tutoring dialogues with both human and computer tutors

Litman, DJ and Forbes-Riley, K (2006) Recognizing student emotions and attitudes on the basis of utterances in spoken tutoring dialogues with both human and computer tutors. Speech Communication, 48 (5). 559 - 590. ISSN 0167-6393

[img] Plain Text (licence)
Available under License : See the attached license file.

Download (1kB)

Abstract

While human tutors respond to both what a student says and to how the student says it, most tutorial dialogue systems cannot detect the student emotions and attitudes underlying an utterance. We present an empirical study investigating the feasibility of recognizing student state in two corpora of spoken tutoring dialogues, one with a human tutor, and one with a computer tutor. We first annotate student turns for negative, neutral and positive student states in both corpora. We then automatically extract acoustic-prosodic features from the student speech, and lexical items from the transcribed or recognized speech. We compare the results of machine learning experiments using these features alone, in combination, and with student and task dependent features, to predict student states. We also compare our results across human-human and human-computer spoken tutoring dialogues. Our results show significant improvements in prediction accuracy over relevant baselines, and provide a first step towards enhancing our intelligent tutoring spoken dialogue system to automatically recognize and adapt to student states. © 2005 Elsevier B.V. All rights reserved.


Share

Citation/Export:
Social Networking:
Share |

Details

Item Type: Article
Status: Published
Creators/Authors:
CreatorsEmailPitt UsernameORCID
Litman, DJdlitman@pitt.eduDLITMAN
Forbes-Riley, K
Centers: University Centers > Learning Research and Development Center (LRDC)
Date: 1 May 2006
Date Type: Publication
Journal or Publication Title: Speech Communication
Volume: 48
Number: 5
Page Range: 559 - 590
DOI or Unique Handle: 10.1016/j.specom.2005.09.008
Schools and Programs: Dietrich School of Arts and Sciences > Computer Science
Dietrich School of Arts and Sciences > Intelligent Systems
Refereed: Yes
ISSN: 0167-6393
Date Deposited: 16 Oct 2014 18:27
Last Modified: 02 Feb 2019 15:59
URI: http://d-scholarship.pitt.edu/id/eprint/23242

Metrics

Monthly Views for the past 3 years

Plum Analytics

Altmetric.com


Actions (login required)

View Item View Item