The Generalizer

I just saw Beth Tipton speak on this tool for designing education studies with the goal of getting inferences for the population. It’s basically MRP, but what is innovative here is the application of these ideas at the design stage.

The online app looks pretty cool. Here’s the demo version. It’s set up specifically for experiments in schools, so it won’t be relevant for most of you, but the general principle should also apply to medical experiments, economic interventions, A/B tests, etc.

This seems like the right way to go. There is no substitute for careful measurement and design—and ultimately measurements and designs should be evaluated based on the goals of analysis.