The correct adjustment of α-levels is a logical prerequisite for valid inferences and conclusions (that is, in the NHST framework). However, if stringent (appropriate) α-control techniques would be applied, many experiments would not reach statistical significance at the conventional α …
Preregistration is the practice of publishing the methodology of experiments before they begin. This strategy reduces problems stemming from publication bias and selective reporting of results. See for example:
A exemplary list of currently preregistered studies can …
Definition of Type I error:
Probability of rejecting null hypothesis when it is TRUE.
Definition of Type II error:
Probability of not rejecting null hypothesis when it is False.
Imagine tests on 1000 hypotheses 100 of which are …
Source URL: https://shinyapps.org/apps/p-hacker/
Source URL: https://shinyapps.org/apps/metaExplorer/#tab-2218-2
Source URL: https://www.shinyapps.org/apps/vs-mpr/
The majority of professors who lecture statistics are unable to interpret a simple t-test correctly as the following empirical data illustrates (adapted from Haller & Krauss, 2002).
Figure 1. Fallacious statistical reasoning in the interpretation of an independent samples …