The Road Back

https://statmodeling.stat.columbia.edu/2020/03/14/the-road-back/

Paul Kedrosky points us to this news article by Liam Mannix, “Cold water poured on scientific studies based on ‘statistical cult.’”

Here’s what I wrote about this when it came up last year:

The whole thing seems pretty pointless to me. I agree with Kristin Sainani that the paper on MBI does not make sense. But I also disagree with all the people involved in this debate in that I don’t think that “type 1 error rate” has any relevance to sports science, or to science more generally. See for example here and here.

I think scientists should be spending more time collecting good data and reporting their raw results for all to see, and less time trying to come up with methods for extracting a spurious certainty out of noisy data. I think this whole type 1, type 2 error thing is a horrible waste of time which is distracting researchers from the much more important problem of getting high quality measurements.