Hi! (This is Dan.) The glorious Josh Loftus from NYU just asked the following question.
Obviously he’s not heard of preregistration.
Seriously though, it’s always good to remember that a lot of ink being spilled over hypothesis testing and it’s statistical brethren doesn’t mean that if we fix that we’ll fix anything. It all comes to naught if
- the underlying model for reality (be it your Bayesian model or your null hypothesis model and test statistic) is rubbish OR
- the process of interest is poorly measured or the measurement error isn’t appropriately modelled OR
- the data under consideration can’t be generalised to a population of interest.
Control of things like Type 1, Type 2, Type S, and Type M is a bit like combing your hair. It’s great if you’ve got hair to comb, but otherwise it leaves you looking a bit silly.
