Depending in the field and impact, reproduction becomes “free” because other scientists try to build on the results. Science is often about chasing the latest, hottest thing
If they can’t reproduce the original, they should get called out eventually
In over 80 volumes of ASTM publications, I would estimate they may amount to more kilos than that.
Almost all of the actual lab work requires statistical determination of repeatability & reproducibility to be calculated between different labs, and the summary is included with each document.
I would say there is way less than a kilo without this.
And the amount of supporting raw data on file amounts to kilos which dwarf the pages published. Formally accessible so everything can be thoroughly reviewed at any time in the future, allowing for complete reconsideration if called for.
Scietific instrumentation doesn't stand still.
So it definitely can be done. Even if it's to the extreme not suitable for everybody else.
The less-reproducible documents are there, they did the best they could, but have a smell not shared by the good stuff. You know "exactly" how good or bad the underlying science turned out to be in the real world.
Paradoxically, or intuitively, as the case may be, if you're going to utilize the less-reliable techniques (most likely because they're the best there is), you may need to know how bad they are most of all.
Maybe other publications should raise the bar on statistics as appropriate, I figure zero statistics is about as far as you can get from ASTM "standards".
Some places probably have a lot further to go than others and it would be nice to have a whole lot sweeter smell all around.
It depends a lot on the area. I'd not be so pessimistic. The problem is how many of the papers that reach newspapers are reproducible? I guess less than the average. And also strange results that are misinterpreted to get a amazing but wrong layman explanation.
Fomite|6 months ago
SJC_Hacker|6 months ago
If they can’t reproduce the original, they should get called out eventually
ktallett|6 months ago
fuzzfactor|6 months ago
Almost all of the actual lab work requires statistical determination of repeatability & reproducibility to be calculated between different labs, and the summary is included with each document.
I would say there is way less than a kilo without this.
And the amount of supporting raw data on file amounts to kilos which dwarf the pages published. Formally accessible so everything can be thoroughly reviewed at any time in the future, allowing for complete reconsideration if called for.
Scietific instrumentation doesn't stand still.
So it definitely can be done. Even if it's to the extreme not suitable for everybody else.
The less-reproducible documents are there, they did the best they could, but have a smell not shared by the good stuff. You know "exactly" how good or bad the underlying science turned out to be in the real world.
Paradoxically, or intuitively, as the case may be, if you're going to utilize the less-reliable techniques (most likely because they're the best there is), you may need to know how bad they are most of all.
Maybe other publications should raise the bar on statistics as appropriate, I figure zero statistics is about as far as you can get from ASTM "standards".
Some places probably have a lot further to go than others and it would be nice to have a whole lot sweeter smell all around.
gus_massa|6 months ago
nothercastle|6 months ago