What Is In a (Non‐) Significant Finding? Moving Beyond False Dichotomies

In: Swiss political science review: SPSR = Schweizerische Zeitschrift für Politikwissenschaft : SZPW = Revue suisse de science politique : RSSP, Band 25, Heft 3, S. 300-311

Abstract

AbstractOne of the most problematic aspect of p‐values is the tendency to dichotomize, whereby statistical significance is equated with scientifically worthwhile and insignificance with worthless findings. This article outlines two approaches that move beyond such dichotomies: minimum Bayes factors and the analysis of credibility. Their use is illustrated through a simple example. The examples show that significant findings may not always be as telling as statistical significance would suggest, whereas non‐significant findings may contain considerable evidence about effects.