Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

A Quantitative Case Study Analysis of the 4Sight Benchmark Assessment

Castagna, Daniel Robert (2009) A Quantitative Case Study Analysis of the 4Sight Benchmark Assessment. Doctoral Dissertation, University of Pittsburgh. (Unpublished)

Primary Text

Download (2MB) | Preview


This study followed students in a suburban middle school (grades 6, 7 and 8) in Western Pennsylvania and confirmed predictions made by the 4Sight benchmark tests (given during the 2007-2008 school year) when compared to the actual student results on the spring 2008 PSSA exam.The researcher evaluated the ability of the 4Sight tests to accurately predict student's scores on the PSSA exam. The Success for All Foundation claimed that this formative assessment can predict (using a linear regression model) how students would have scored on the PSSA test if it had been given on the same day. The researcher confirmed this allegation with a case study with an entire school population. The Western Middle School administered four rounds of 4Sight testing during the 2007-2008 school year with the last round being administered one week after the PSSA exam. A comparison was analyzed between the third and fourth round of tests administered in January and April and the PSSA test in April. In their 2007 Technical Manual, the Success for All Foundation used third quarter test results to analyze correlation to the PSSA test. The researcher duplicated this process to compare correlations and added the fourth test analysis for additional findings. A Kappa coefficient formula was also used to compare predicted and actual PSSA classification categories.Since the 4Sight exam is new, little research has been done to track its effectiveness. Student's raw score results were charted (by grade level) from the four 4Sight exams. Along with their raw score is the predicted categorical classification created by the Success for All Foundation that coincides with categories reported after PSSA testing. The last column of the test score data shows students actual raw score results and actual categorical classifications on the 2008 PSSA test (published near July of 2008). This format allowed the researcher to chart students' progress from the third and fourth 4Sight exams and analyze correlation among predicted and actual results.


Social Networking:
Share |


Item Type: University of Pittsburgh ETD
Status: Unpublished
CreatorsEmailPitt UsernameORCID
Castagna, Daniel
ETD Committee:
TitleMemberEmail AddressPitt UsernameORCID
Committee ChairHughes, Seanshughes@pitt.eduSHUGHES
Committee MemberWerlinich, Josephjwerlini@pitt.eduJWERLINI
Committee MemberGraf,
Committee MemberBickel, Williambickel@pitt.eduBICKEL
Date: 12 January 2009
Date Type: Completion
Defense Date: 22 October 2008
Approval Date: 12 January 2009
Submission Date: 17 November 2008
Access Restriction: 5 year -- Restrict access to University of Pittsburgh for a period of 5 years.
Institution: University of Pittsburgh
Schools and Programs: School of Education > Administrative and Policy Studies
Degree: EdD - Doctor of Education
Thesis Type: Doctoral Dissertation
Refereed: Yes
Uncontrolled Keywords: benchmark tests; big business of testing; formative assessment; inform instructional practice; summative assessment
Other ID:, etd-11172008-133215
Date Deposited: 10 Nov 2011 20:05
Last Modified: 15 Nov 2016 13:51


Monthly Views for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item