Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction

Duric, Z and Gray, WD and Heishman, R and Fayin, L and Rosenfeld, A and Schoelles, MJ and Schunn, C and Wechsler, H (2002) Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction. Proceedings of the IEEE, 90 (7). 1272 - 1288. ISSN 0018-9219

[img] Plain Text (licence)
Available under License : See the attached license file.

Download (1kB)


This paper describes technology and tools for intelligent human-computer interaction (IHCI) where human cognitive, perceptual, motor, and affective factors are modeled and used to adapt the H-C interface. IHCI emphasizes that human behavior encompasses both apparent human behavior and the hidden mental state behind behavioral performance. IHCI expands on the interpretation of human activities, known as W4 (what, where, when, who). While W4 only addresses the apparent perceptual aspect of human behavior, the W5+ technology for IHCI described in this paper addresses also the why and how questions, whose solution requires recognizing specific cognitive states. IHCI integrates parsing and interpretation of nonverbal information with a computational cognitive model of the user, which, in turn, feeds into processes that adapt the interface to enhance operator performance and provide for rational decision-making. The technology proposed is based on a general four-stage interactive framework, which moves from parsing the raw sensory-motor input, to interpreting the user's motions and emotions, to building an understanding of the user's current cognitive state. It then diagnoses various problems in the situation and adapts the interface appropriately. The interactive component of the system improves processing at each stage. Examples of perceptual, behavioral, and cognitive tools are described throughout the paper. Adaptive and intelligent HCI are important for novel applications of computing, including ubiquitous and human-centered computing. © 2002 IEEE.


Social Networking:
Share |


Item Type: Article
Status: Published
CreatorsEmailPitt UsernameORCID
Duric, Z
Gray, WD
Heishman, R
Fayin, L
Rosenfeld, A
Schoelles, MJ
Schunn, Cschunn@pitt.eduSCHUNN0000-0003-3589-297X
Wechsler, H
Centers: Other Centers, Institutes, Offices, or Units > Learning Research & Development Center
Date: 1 January 2002
Date Type: Publication
Journal or Publication Title: Proceedings of the IEEE
Volume: 90
Number: 7
Page Range: 1272 - 1288
DOI or Unique Handle: 10.1109/jproc.2002.801449
Schools and Programs: Dietrich School of Arts and Sciences > Psychology
Refereed: Yes
ISSN: 0018-9219
Article Type: Review
Date Deposited: 19 Aug 2014 15:06
Last Modified: 28 Mar 2020 14:55


Monthly Views for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item