Twitter thread with discussions and references Illustrating degrees of freedom in terms of sample size and dimensionalityĭegrees of freedom in inferential statistics The crisis of politicization within and beyond scienceĭeclaring and Diagnosing Research Designs The Reproducibility & Replicability Crisis & PoliticsĪndrew Gelman's blog 1 (timeline of events + Fiske fiasco), 2 (why psychology), 3 (centered around social psychology) Take from Editors of Journal of Experimental Political Science Summary of open-science initiatives in Pol-Sci Psychology is not in crisis (Feldman's Barret, 2015)
Questions about what counts as replication In 72% of these cases, nonsignificant results were misinterpreted (Quantifying Support for the Null Hypothesis in Psychology Quantifying Support for the Null Hypothesis in Psychology Variation in Replicability: A “Many Labs” Replication Project Students, CCS, MTurk similar on Economic GamesĮstimating the Reproducibility of Psychological ScienceĮvaluating the replicability of social science experiments in Nature and Science between 20Įvaluating replicability of laboratory experiments in economics WEIRD (Western, Educated, Industrialized, Rich, and Democratic)ĩ9% of all published studies rely on WEIRD samplesĪttracting representative samples requires thought Replication, Communication, and the Population Dynamics of Scientific DiscoveryĮmphasis on (Rate of) Published Positive Results - per scientific field Publication bias and the canonization of false facts Questionable Research Practices Revisited Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling Publication Bias (file drawer problem) & Null Findings Is science really facing a reproducibility crisis, and do we need it to? Scientists Self-Deception, Bias, Cognitive Fallacies in Research making Peer-review role & Science self-correction myth The Irreproducibility Crisis of Modern Science: Causes, Consequences and the Road to Reformġ,500 scientists lift the lid on reproducibility Most published research findings are false (Ioannidis 2005) Reproducibility & Replicability Crisis All Sciences