Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Evaluation of educational software

Schleyer, TKL and Johnson, LA (2003) Evaluation of educational software. Journal of Dental Education, 67 (11). 1221 - 1228. ISSN 0022-0337

[img] Plain Text (licence)
Available under License : See the attached license file.

Download (1kB)

Abstract

Evaluation is an important component of developing educational software. Ideally, such evaluation quantifies and qualifies the effects of a new educational intervention on the learning process and outcomes. Conducting meaningful and rigorous educational evaluation is difficult, however. Challenges include defining and measuring educational outcomes, accounting for media effects, coping with practical problems in designing studies, and asking the right research questions. Practical considerations that make the design of evaluation studies difficult include confounding, potentially small effect sizes, contamination effects, and ethics. Two distinct approaches to evaluation are objectivist and subjectivist. These two complement each other in describing the whole range of effects a new educational program can have. Objectivist demonstration studies should be preceded by measurement studies that assess the reliability and validity of the evaluation instrument(s) used. Many evaluation studies compare the performance of learners who are exposed to either the new program or a more traditional approach. However, this method is problematic because test or exam performance is often a weak indicator of competence and may fail to capture important nuances in outcomes. Subjectivist studies are more qualitative in nature and may provide insights complementary to those gained with objectivist studies. Several published examples are used in this article to illustrate different evaluation methods. Readers are encouraged to contemplate a wide range of evaluation study designs and explore increasingly complex questions when evaluating educational software.


Share

Citation/Export:
Social Networking:
Share |

Details

Item Type: Article
Status: Published
Creators/Authors:
CreatorsEmailPitt UsernameORCID
Schleyer, TKLtitus@pitt.eduTITUS0000-0003-1829-971X
Johnson, LA
Centers: Other Centers, Institutes, or Units > Center for Dental Informatics
Date: 1 November 2003
Date Type: Publication
Journal or Publication Title: Journal of Dental Education
Volume: 67
Number: 11
Page Range: 1221 - 1228
Schools and Programs: School of Dental Medicine > Dental Science
Refereed: Yes
ISSN: 0022-0337
MeSH Headings: Computer Simulation; Computer-Assisted Instruction--methods; Education, Dental--methods; Educational Measurement--standards; Evaluation Studies as Topic; Humans; Organizational Case Studies; Patient Simulation; Software--standards; Software Design; Software Validation; United States; User-Computer Interface
PubMed ID: 14650503
Date Deposited: 12 Sep 2012 20:43
Last Modified: 05 Feb 2019 07:55
URI: http://d-scholarship.pitt.edu/id/eprint/14118

Metrics

Monthly Views for the past 3 years

Plum Analytics


Actions (login required)

View Item View Item