[Ilnsk]

Yeah ok but most science doesn't need a supercollider. Most of the erroneous science is in the social sciences, psych especially, and there really isn't any equivalent of a supercollider in psychology. The only possible equivalent is a massive study of like 200+ subjects but once you're at that scale you can be pretty confident that your statistics have converged, anyway. The real issue is low sample size(<100 although most studies done are <30) psychology studies which are by and large relatively easy to reproduce.

[vlovich123]

I don’t think all the problems that cause lack of reproducibility come from small sample sizes. For example, P-hacking is a thing (intentionally or not) and larger sample sizes don’t solve that. Experiment registration can help so you can track negative results but that doesn’t help if there’s no reproduction attempt (ie you could just have gotten lucky). There’s also straight up fraud you have to deal with.

The point is, op is right that it’s expensive. The computer industry that we’re in claims to be data driven but I’ve observed numerous poor quality studies being done to drive decisions that I’m pretty jaded (no reproduction, poor sample sizes, skewed sample sizes where it’s employees, etc etc). And these are smart people where the decisions being made can impact the financial outcome.