Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

PEER REVIEW IN DESIGN: UNDERSTANDING THE IMPACT OF COLLABORATION ON THE REVIEW PROCESS AND STUDENT PERCEPTION

Mandala, Mahender Arjun (2016) PEER REVIEW IN DESIGN: UNDERSTANDING THE IMPACT OF COLLABORATION ON THE REVIEW PROCESS AND STUDENT PERCEPTION. Doctoral Dissertation, University of Pittsburgh.

[img]
Preview
PDF (Final Version with ETD corrections)
Updated Version

Download (1MB) | Preview

Abstract

A cornerstone of design and design education is frequent situated feedback. With increasing class sizes, and shrinking financial and human resources, providing rich feedback to students becomes increasingly difficult. In the field of writing, web-based peer review—the process of utilizing equal status learners within a class to provide feedback to each other on their work using networked computing systems—has been shown to be a reliable and valid source of feedback in addition to improving student learning.
Designers communicate in myriad ways, using the many languages of design and combining visual and descriptive information. This complex discourse of design intent makes peer reviews by design students ambiguous and often not helpful to the receivers of this feedback. Furthermore, engaging students in the review process itself is often difficult. Teams can complement individual diversity and may assist novice designers collectively resolve complex task. However, teams often incur production losses and may be impacted by individual biases. In the current work, we look at utilizing a collaborative team of reviewers, working collectively and synchronously, in generating web based peer reviews in a sophomore engineering design class.
Students participated in a cross-over design, conducting peer reviews as individuals and collaborative teams in parallel sequences. Raters coded the feedback generated on the basis of their appropriateness and accuracy. Self-report surveys and passive observation of teams conducting reviews captured student opinion on the process, its value, and the contrasting experience they had conducting team and individual reviews.
We found team reviews generated better quality feedback in comparison to individual reviews. Furthermore, students preferred conducting reviews in teams, finding the process ‘fun’ and engaging. We observed several learning benefits of using collaboration in reviewing including improved understanding of the assessment criteria, roles, expectations, and increased team reflection. These results provide insight into how to improve the review process for instructors and researchers, and forms a basis for future research work in this area.
With respect to facilitating peer review process in design based classrooms, we also present recommendations for creating effective review system design and implementation in classroom supported by research and practical experience.


Share

Citation/Export:
Social Networking:
Share |

Details

Item Type: University of Pittsburgh ETD
Status: Published
Creators/Authors:
CreatorsEmailPitt UsernameORCID
Mandala, Mahender Arjunm.mandala@pitt.eduMAM4470000-0001-6903-5250
ETD Committee:
TitleMemberEmail AddressPitt UsernameORCID
Committee ChairPearlman, Jonathanjlp46@pitt.eduJLP46
Committee MemberGoldberg, Marymrh35@pitt.eduMRH35
Committee MemberSchunn, Christianschunn@pitt.eduSCHUNN
Committee MemberDow, Stevenspdow@ucsd.edu
Date: 13 September 2016
Date Type: Publication
Defense Date: 22 July 2016
Approval Date: 13 September 2016
Submission Date: 26 July 2016
Access Restriction: No restriction; Release the ETD for access worldwide immediately.
Number of Pages: 159
Institution: University of Pittsburgh
Schools and Programs: School of Health and Rehabilitation Sciences > Rehabilitation Science and Technology
Degree: PhD - Doctor of Philosophy
Thesis Type: Doctoral Dissertation
Refereed: Yes
Uncontrolled Keywords: peer review, feedback, collaboration, team work, collective review, critique, design, learning, education, engineering, creative, web-based
Date Deposited: 13 Sep 2016 14:32
Last Modified: 15 Nov 2016 14:34
URI: http://d-scholarship.pitt.edu/id/eprint/28637

Metrics

Monthly Views for the past 3 years

Plum Analytics


Actions (login required)

View Item View Item