Winichakul, K. Pun and Lezama, Guillermo and Mustafi, Priyoma and Lepper, Marissa and Wilson, Alistair and Danz, David and Vesterlund, Lise
(2024)
The Effect of Experimenter Demand on Inference.
Working Paper.
UNSPECIFIED.
(Unpublished)
Abstract
To assess the threat of experimenter demand, we ask whether a hypothetical 'ill-intentioned' researcher can manipulate inference. Four classic behavioral comparative statics are evaluated, and the potential for false inference is gauged by differentially applying strong positive and negative experimenter demand across the relevant decision pair. Evaluating three different subject pools (laboratory, Prolific, and MTurk) we find no evidence of experimenter demand eliminating or reversing directional effects. The response to experimenter demand is very limited for all three subject pools and is not large enough to generate false negatives, though we do find evidence of false positives when testing precise nulls in larger online-subject pools.
Share
| Citation/Export: |
|
| Social Networking: |
|
Details
Metrics
Monthly Views for the past 3 years
Plum Analytics
Actions (login required)
 |
View Item |
![[feed]](/images/feed-icon-32x32.png){kind=icon}