Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

COMPARING DIF DETECTION FOR MULTIDIMENSIONAL POLYTOMOUS MODELS USING MULTI GROUP CONFIRMATORY FACTOR ANALYSIS AND THE DIFFERENTIAL FUNCTIONING OF ITEMS AND TESTS

Kannan, Priya (2011) COMPARING DIF DETECTION FOR MULTIDIMENSIONAL POLYTOMOUS MODELS USING MULTI GROUP CONFIRMATORY FACTOR ANALYSIS AND THE DIFFERENTIAL FUNCTIONING OF ITEMS AND TESTS. Doctoral Dissertation, University of Pittsburgh. (Unpublished)

[img]
Preview
PDF
Primary Text

Download (2MB) | Preview

Abstract

This study evaluated the robustness of DIF detection for multidimensional polytomous items using two different estimation methods, MG-CFA and MGRM-DFIT. A simulation study across 960 study conditions was performed. The purpose of this study was to establish the Type-I error rate and Power of DIF detection for the MG-CFA and MGRM-DFIT estimation methods across the study conditions. The MGRM-DFIT method consistently controlled Type-I error rate under alpha across all study conditions. Though the MGRM-DFIT method demonstrated high power in detecting DIF for the combined items, it had lower power in detecting DIF for each item individually. The MGRM-DFIT method had higher power of DIF detection when impact (true distributional differences) is in the opposite direction of manipulated DIF. Overall, compared to the non-DIF items, NCDIF values are larger, and CDIF values are smaller for the 4 DIF items. Across the replications and the study conditions, CDIF was not as consistent as NCDIF. The MG-CFA method demonstrated slightly inflated Type-I error rate in a couple of study conditions (particularly in the presence of impact). However, the MG-CFA method demonstrated lower power across all study conditions. This could partly be explained by the low magnitude of DIF that was manipulated in the 'α/λ' parameter in this study. Parameter estimation for the MGRM, and the MGRM-DFIT method should be incorporated as part of commonly used software packages. In general, the MG-CFA method is recommended for DIF detection with multidimensional polytomous types of items, since it performs more consistently as a univariate test and as a multivariate test, and is easily available as part of several commonly used software packages.


Share

Citation/Export:
Social Networking:
Share |

Details

Item Type: University of Pittsburgh ETD
Status: Unpublished
Creators/Authors:
CreatorsEmailPitt UsernameORCID
Kannan, Priyaprk16@pitt.edu, pria.kannan@gmail.comPRK16
ETD Committee:
TitleMemberEmail AddressPitt UsernameORCID
Committee ChairKim, Kevin Hkhkim@education.pitt.eduKHKIM
Committee MemberStone, Clementcas@pitt.eduCAS
Committee MemberKirisci, Leventlevent@pitt.eduLEVENT
Committee MemberLane, Suzannesl@pitt.eduSL
Date: 13 May 2011
Date Type: Completion
Defense Date: 4 April 2011
Approval Date: 13 May 2011
Submission Date: 18 April 2011
Access Restriction: 5 year -- Restrict access to University of Pittsburgh for a period of 5 years.
Institution: University of Pittsburgh
Schools and Programs: School of Education > Psychology in Education
Degree: PhD - Doctor of Philosophy
Thesis Type: Doctoral Dissertation
Refereed: Yes
Uncontrolled Keywords: ; Differential Item Functioning; Item Response Theory; Multi group Confirmatory Factor Analysis; Multidimensional Graded Response Models; Multidimensional models; Polytomous models; Structural Equation Modeling
Other ID: http://etd.library.pitt.edu/ETD/available/etd-04182011-000321/, etd-04182011-000321
Date Deposited: 10 Nov 2011 19:38
Last Modified: 19 Dec 2016 14:35
URI: http://d-scholarship.pitt.edu/id/eprint/7299

Metrics

Monthly Views for the past 3 years

Plum Analytics


Actions (login required)

View Item View Item