Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Developing a protocol for an educational software competition.

Schleyer, T and Johnson, L (2001) Developing a protocol for an educational software competition. Proceedings / AMIA ... Annual Symposium. AMIA Symposium. 603 - 606. ISSN 1531-605X

[img] Plain Text (licence)
Available under License : See the attached license file.

Download (1kB)

Abstract

This project developed a protocol for the inaugural Instructional Software Competition of the American Dental Education Association (ADEA). The evaluation instrument was derived from the Guidelines for the Design of Educational Software developed by the ANSI-accredited Standards Committee for Dental Informatics. Eleven judges were calibrated in a conference call and rated a total of 30 submissions using a 66-question instrument. The maximum score was 204 points. The mean score of WWW-based programs was 106.7 points, and of CD-ROM-based programs 109.5 points. The summative review of the judging process identified several potential improvements, such as distinguishing between standalone programs and educational support material; increasing the number of answer choices on rating scales; differential weighting of criteria; and a more discriminative approach to judging formative and summative evaluations. We plan to improve the protocol by supporting the process through a Web-based application; calibrating judges with an online handbook; improving and adapting the rating instrument itself; using at least three judges for each program; and conducting a measurement study.


Share

Citation/Export:
Social Networking:
Share |

Details

Item Type: Article
Status: Published
Creators/Authors:
CreatorsEmailPitt UsernameORCID
Schleyer, Ttitus@pitt.eduTITUS0000-0003-1829-971X
Johnson, L
Contributors:
ContributionContributors NameEmailPitt UsernameORCID
EditorTeich, JUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
EditorSuermondt, JUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
EditorHripcsak, GUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Centers: Other Centers, Institutes, or Units > Center for Dental Informatics
Date: 1 January 2001
Date Type: Publication
Access Restriction: No restriction; Release the ETD for access worldwide immediately.
Journal or Publication Title: Proceedings / AMIA ... Annual Symposium. AMIA Symposium
Page Range: 603 - 606
Institution: University of Pittsburgh
Schools and Programs: School of Dental Medicine > Dental Science
Refereed: Yes
ISSN: 1531-605X
PubMed Central ID: PMC2243689
PubMed ID: 11825257
Date Deposited: 02 Oct 2012 18:53
Last Modified: 05 Feb 2019 07:55
URI: http://d-scholarship.pitt.edu/id/eprint/14811

Metrics

Monthly Views for the past 3 years

Plum Analytics


Actions (login required)

View Item View Item