User Tools

Site Tools


Lab experiments

Study design

The study design is not described in sufficient detail to allow a critical review of the performed statistical analysis. Please describe the links between the number of included subjects/animals and the number of statistically analysed samples. A clear description of the study design, sample sizes, and analusis units is necessary for evaluating the validity of the analysis results. See Parsons NR, Teare MD, Sitch AJ. Unit of analysis issues in laboratory-based research. eLife 2018;7:e32486. DOI:

One study hypothesis but many tested hypotheses

It is claimed in the manuscript that it shows “strong evidence”. The empirical support for the reported findings is, however, unclear. A large number of p-values representing statistically significant results from significance tests are presented, but the number of performed significance tests is not disclosed, and it is not possible to deduct. The relation between the study hypothesis and the tested hypothesis is also unclear. The results presentation may represent major multiplicity problems and several false positive test results. As no power calculation is presented, the number of false negative tests may also be substantial. Moreover, the statistical tests have been performed using statistical methods that requires statistically independent observations, and it is unclear if this is the case.

labexps.txt · Last modified: 2020/02/16 18:54 by ranstam