Hi! (This is Dan.) The glorious Josh Loftus from NYU just asked the following question.
Obviously he’s not heard of preregistration.
Seriously though, it’s always good to remember that a lot of ink being spilled over hypothesis testing and it’s statistical brethren doesn’t mean that if we fix that we’ll fix anything. It all comes to naught if
- the underlying model for reality (be it your Bayesian model or your null hypothesis model and test statistic) is rubbish OR
- the process of interest is poorly measured or the measurement error isn’t appropriately modelled OR
- the data under consideration can’t be generalised to a population of interest.