Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Exploring Practitioner Data Use to Support Improvement Work in Education

Premo, Anna Elisabeth (2024) Exploring Practitioner Data Use to Support Improvement Work in Education. Doctoral Dissertation, University of Pittsburgh. (Unpublished)

[img]
Preview
PDF
Download (3MB) | Preview

Abstract

Improvement networks have become a popular approach to educational change. In theory, data is meant to fundamentally anchor these efforts. However, there are gaps in terms of which, when, and why data are used in practice and how they should be created to better meet practitioner needs. Across three studies, this dissertation provides an in-depth exploration of practitioner data creation and use in a focal improvement network.

Study 1: This mixed-methods case study investigated different ways in which data were created and used, as well as when created data was not used and when data was desired but not available. The findings showed while improvement data were predominantly created, evaluation data were more frequently used to navigate the complex socio-political dynamics typical of improvement networks.

Study 2: Building on practitioner needs identified in Study 1, this study develops an approach for creating and using evaluation data to understand the relationship between network processes and outcomes. In particular, it explored analytic techniques for probing the relationship between teacher implementation of proven instructional practices and growth in student performance. Analyses consistently showed benefits for student growth, overall and for historically underserved and underrepresented students, when teachers more consistently implemented the targeted instructional practices.

Study 3: Addressing another need identified in Study 1, this study develops an approach for creating and using evaluation data to understand the overall impact of the improvement network on student outcomes. In particular, it develops and tests a coarsened exact matching approach for evaluating effects of the network on growth of student outcomes relative to a set of algorithmically matched non-network schools. Overall, many schools participating in the network showed growth that outpaced matched schools, with historically disadvantaged students benefiting especially.

This dissertation suggests implications for theory and practice in terms of how data can be created in order to be more effectively used in improvement networks. Importantly, it emphasizes intentional data creation and use that minimizes associated practitioner effort while maximizing data value to practitioners. It also provides cross-validated examples of new approaches to improvement network evaluation that should be replicated in other initiatives.


Share

Citation/Export:
Social Networking:
Share |

Details

Item Type: University of Pittsburgh ETD
Status: Unpublished
Creators/Authors:
CreatorsEmailPitt UsernameORCID
Premo, Anna Elisabethanna.premo@pitt.eduaep750009-0003-3067-3433
ETD Committee:
TitleMemberEmail AddressPitt UsernameORCID
Committee ChairSchunn, Christianschunn@pitt.edu
Committee MemberRussell, Jennifer Linjennifer.russell@vanderbilt.edu
Committee MemberPetrosky, Anthonytpetrosk@pitt.edu
Committee MemberCorrenti, Richardrcorrent@pitt.edu
Committee MemberIriti, Jennifeririti@pitt.edu
Date: 28 May 2024
Date Type: Publication
Defense Date: 1 April 2024
Approval Date: 28 May 2024
Submission Date: 12 April 2024
Access Restriction: 1 year -- Restrict access to University of Pittsburgh for a period of 1 year.
Number of Pages: 129
Institution: University of Pittsburgh
Schools and Programs: School of Education > Learning Sciences and Policy
Degree: PhD - Doctor of Philosophy
Thesis Type: Doctoral Dissertation
Refereed: Yes
Uncontrolled Keywords: mixed methods, quasi-experimental, continuous improvement, improvement science, networked improvement communities, improvement networks, data use, evidence use, evaluation, case study, research practice partnership
Date Deposited: 28 May 2024 20:06
Last Modified: 28 May 2025 12:15
URI: http://d-scholarship.pitt.edu/id/eprint/46098

Metrics

Monthly Views for the past 3 years

Plum Analytics


Actions (login required)

View Item View Item