Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Comparative study of heuristic evaluation and usability testing methods

Thyvalikakath, TP and Monaco, V and Thambuganipalle, H and Schleyer, T (2009) Comparative study of heuristic evaluation and usability testing methods. In: UNSPECIFIED UNSPECIFIED, 322 - 327. ISBN UNSPECIFIED

[img] Plain Text (licence)
Available under License : See the attached license file.

Download (1kB)


Usability methods, such as heuristic evaluation, cognitive walk-throughs and user testing, are increasingly used to evaluate and improve the design of clinical software applications. There is still some uncertainty, however, as to how those methods can be used to support the development process and evaluation in the most meaningful manner. In this study, we compared the results of a heuristic evaluation with those of formal user tests in order to determine which usability problems were detected by both methods. We conducted heuristic evaluation and usability testing on four major commercial dental computer-based patient records (CPRs), which together cover 80% of the market for chairside computer systems among general dentists. Both methods yielded strong evidence that the dental CPRs have significant usability problems. An average of 50% of empirically-determined usability problems were identified by the preceding heuristic evaluation. Some statements of heuristic violations were specific enough to precisely identify the actual usability problem that study participants encountered. Other violations were less specific, but still manifested themselves in usability problems and poor task outcomes. In this study, heuristic evaluation identified a significant portion of problems found during usability testing. While we make no assumptions about the generalizability of the results to other domains and software systems, heuristic evaluation may, under certain circumstances, be a useful tool to determine design problems early in the development cycle. © 2009 ITCH 2009 Steering Committee and IOS Press. All rights reserved.


Social Networking:
Share |


Item Type: Book Section
Status: Published
CreatorsEmailPitt UsernameORCID
Thyvalikakath, TPtpt1@pitt.eduTPT1
Monaco, V
Thambuganipalle, H
Schleyer, Ttitus@pitt.eduTITUS0000-0003-1829-971X
Centers: Other Centers, Institutes, Offices, or Units > Center for Dental Informatics
Date: 1 January 2009
Date Type: Publication
Access Restriction: No restriction; Release the ETD for access worldwide immediately.
Journal or Publication Title: Studies in Health Technology and Informatics
Volume: 143
Page Range: 322 - 327
DOI or Unique Handle: 10.3233/978-1-58603-979-0-322
Institution: University of Pittsburgh
Schools and Programs: School of Dental Medicine > Dental Science
Refereed: Yes
ISSN: 0926-9630
Date Deposited: 24 Sep 2012 20:45
Last Modified: 05 Feb 2019 07:55


Monthly Views for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item