Learning from Null Results: A Bottom-Up Approach. (With Ala' Alrababa'h, Andrea Dillon, Dominik Hangartner, Jens Hainmueller, Michael Hotard, David Laitin, and Jeremy Weinstein).
Political Analysis
A barrier to generating cumulative knowledge in political science is the inability of researchers to observe the results from the full set of research designs that scholars have conceptualized, implemented, and analyzed. For a variety of reasons, studies that produce null findings are especially likely to be unobserved, creating biases in publicly accessible research. While several approaches have been suggested to overcome this problem, none have yet proved adequate. We propose a new model in which scholars post short “null results reports” online that summarize their research designs, findings, and interpretations. We discuss a template for these reports and illustrate their utility with two experimental studies focused on naturalization of immigrants in the United States and attitudes toward Syrian refugees in Jordan. We conclude with a discussion of how to overcome incentive problems and inculcate a discipline-wide norm of publicizing null findings.
Click here for the: Article | Supplementary Information | Working Paper | PAP