The following is an analysis of the evidence from my first-author publications. This was motivated largely by Michael Inzlicht‘s refreshing self-analysis of the evidence in some of his own research (link1, link2) and, naturally, the now omnipresent concerns over replication in psychological science. The purpose of this exercise is, first and foremost, accountability.
I’ve taken only one test statistic from each experiment/study (whichever was the most important) and I’ve excluded analyses in which we argued a null (they violate the logic of these tests).
Here are the studies that were included [excepting 3 experiments from Pennycook, Fugelsang, & Koehler (2012, Cognition) and the single study from Pennycook et al.(2015b, BRM). Click here for a larger version of the image.