Skip to content
Free planNo credit card requiredStart writing

SAMPL guidelines: what to report for every statistical analysis

Updated 8 min read

Short answer:

The SAMPL guidelines (Statistical Analyses and Methods in the Published Literature) say how to report basic statistics in a research article. In the methods, state the purpose of each analysis, which test answered which question, how you checked its assumptions, the alpha level, whether tests were one- or two-sided, and the software. In the results, give the numbers analyzed, suitable descriptive statistics, the effect size with a confidence interval, and exact P values. They were written by Thomas Lang and Douglas Altman and published in 2013.

This guide is for anyone writing the methods and results of a quantitative study, and for supervisors and reviewers checking one. It belongs to our series on clinical studies and reporting.

What SAMPL is and where it fits

Design checklists such as CONSORT 2010 (trials) and STROBE 2007 (observational studies) tell you what to report about how the study was done. SAMPL covers the layer underneath: how to report the statistics in any of them. Use it alongside the design checklist, not instead of it.

SAMPL is written as guidance, in points under headings, not as a numbered list. The table below is our condensed version, numbered M (methods) and R (results) for reference, as in the Reviewer guideline check. Our reporting checklists template has a shorter one-page summary to fill.

#AreaReport
M1Data preparationAny change to the raw data before analysis: transformations, categorization, imputation of missing values
M2PurposeThe purpose of each analysis, tied to an objective
M3VariablesThe variables in each analysis, each summarized with suitable descriptive statistics
M4Important differenceWhere possible, the smallest difference considered clinically or practically important
M5MethodsThe main methods, clear about which method was used for which analysis
M6AssumptionsThat the data met each test's assumptions, and how that was checked
M7Alpha and sidednessThe alpha level and whether tests were one- or two-sided
M8SoftwareThe software and its version
M9SupplementaryMethods for sensitivity analyses and missing data
M10Post hocUnplanned analyses, including subgroups, identified as exploratory
R1SampleThe number analyzed in each group, with losses and exclusions and their reasons
R2DescriptivesMean and SD for roughly normal data; median and interquartile range (or range) for skewed data
R3PercentagesNumerators and denominators with every percentage
R4EffectFor main comparisons, the size of the difference with a confidence interval
R5P valuesExact P values, with the test used
R6AssociationThe measure of association with its confidence interval, and the direction
R7 to R9RegressionHow variables were chosen and entered; checks of assumptions, collinearity and fit; coefficients with confidence intervals
R10ANOVAThe model, the factors, the between-group tests and effect sizes
R11SurvivalThe event, how censoring was handled, survival estimates with confidence intervals
R12BayesianPriors and why, the model, posterior estimates with credible intervals, sensitivity to the priors

What to report for each common test

SAMPL gives principles; this table applies them to the tests most papers use. For choosing the test in the first place, see which statistical test to use.

TestMethods should sayResults should giveExample (invented)
Independent t-testTwo-sided, alpha, how normality and equal variances were checked, Welch or StudentMean (SD) per group, mean difference with 95% CI, t, df, exact P, effect size"Mean difference 4.2 points (95% CI 1.1 to 7.3); t(86) = 2.69, P = 0.009; d = 0.57"
Paired t-testThat observations were paired and howMean of the differences with 95% CI, t, df, P"Mean change −3.1 kg (95% CI −4.4 to −1.8); t(29) = 4.87, P < 0.001"
One-way ANOVAThe factor, levels, assumption checks, post hoc method and correctionGroup means (SD), F, both df, P, effect size (eta squared), post hoc differences with CIs"F(2, 117) = 5.41, P = 0.006, η² = 0.08"
Chi-squareExpected counts checked; Fisher's exact test if smallCounts and percentages with denominators, chi-square, df, P, and a risk difference or ratio with CI"18/60 (30%) vs 9/62 (15%); risk ratio 2.07 (95% CI 1.01 to 4.24)"
Mann-Whitney UWhy non-parametricMedians (IQR) per group, U, P, and an effect estimate (such as the Hodges-Lehmann difference) with CI"Median 12 (IQR 8 to 17) vs 9 (6 to 13); U = 1,412, P = 0.02"
CorrelationPearson or Spearman, and whyr with 95% CI, n, P, and a scatterplot"r = 0.42 (95% CI 0.24 to 0.57), n = 104"
Linear regressionOutcome, predictors, how chosen, checks of residuals and collinearityCoefficients with 95% CIs, R², n"Each additional year of age: 0.8 mmHg (95% CI 0.5 to 1.1)"
Logistic regressionOutcome coding, predictors, events per variable, fitOdds ratios with 95% CIs, the number of events"OR 1.9 (95% CI 1.2 to 3.0); 74 events"
SurvivalEvent, censoring, Kaplan-Meier, log-rank or Cox, proportional hazards checkMedian survival with CI, hazard ratio with CI, numbers at risk"HR 0.71 (95% CI 0.55 to 0.92)"

All numbers in the example column are invented to show the format.

Effect sizes and confidence intervals

The most important SAMPL point for most papers: report the size of the effect and its precision, not only whether it was "significant".

  • Use the natural units first. "4.2 points on a 0 to 100 scale" or "a 3.1 kg loss" means more to readers than a standardized effect. Add a standardized effect (d, eta squared, r) for comparisons across studies.
  • Give a confidence interval for every main estimate. The 95% CI shows the range of effects the data are compatible with. "Mean difference 2.0 (95% CI −0.5 to 4.5)" tells the reader the study cannot rule out no effect or a fairly large one.
  • Compare with the important difference (M4). If you set a minimal important difference, say whether the CI includes it.
  • For ratios, give the absolute numbers too. A risk ratio of 2 can mean 1 in 1,000 versus 2 in 1,000, or 30% versus 60%.

P values

  • Give exact values: P = 0.03, P = 0.41. Use P < 0.001 for very small ones. Not "P < 0.05", not "NS".
  • Name the test that produced each P value.
  • Do not read P > 0.05 as "no effect". Absence of evidence is not evidence of absence; look at the CI. If you need evidence for the null, a Bayesian analysis can provide it; see Bayes factor explained.
  • Correct for multiple comparisons when you make many, and say how.
  • Mark exploratory analyses (M10) so readers do not treat them as confirmatory.

Common mistakes

  1. Mean ± SE to describe data. The SE shrinks with sample size and makes data look tidier than they are. Use the SD for spread and the CI for precision.
  2. Mean (SD) for skewed data. Length of stay, costs and counts are usually skewed; give the median and interquartile range.
  3. Percentages without denominators. "45% improved" of how many?
  4. Only P values. No estimate, no interval.
  5. "Trend toward significance" for P = 0.07. Report the estimate and CI and let them speak.
  6. Unnamed tests. "Data were analyzed with appropriate tests" tells the reader nothing.
  7. Assumptions never checked. Normality, equal variances, proportional hazards. See how to test for normality.
  8. Subgroup claims from separate P values, rather than a test of interaction.
  9. Software without a version.

A worked example (invented)

Example (invented for illustration). A draft results paragraph reads: "The intervention group improved significantly more than controls (p<0.05). Anxiety scores were 8.2 ± 0.6 and 10.4 ± 0.7."

Revised to SAMPL:

"At 8 weeks, 44 of 48 participants in the intervention group and 45 of 50 in the control group were analyzed (Figure 1). Mean GAD-7 scores were 8.2 (SD 4.1) and 10.4 (SD 4.9). The mean difference was −2.2 points (95% CI −4.1 to −0.3; Student's t(87) = 2.29, P = 0.02), smaller than the 4-point difference we prespecified as important. Analyses used R version 4.4."

The revision gives the numbers analyzed (R1), the SD instead of the SE (R2), the effect and CI (R4), an exact P with its test (R5), the comparison with the important difference (M4) and the software (M8). It also reads more honestly: the effect is real but smaller than the team hoped.

Checking your statistics in AI for Research

Two parts of AI for Research help here.

  • The Reviewer guideline check now includes SAMPL (2013) and SAGER (2016), with CONSORT 2010, STROBE 2007, PRISMA 2020, CARE 2013, STARD 2015, COREQ 2007, SRQR 2014 and SQUIRE 2.0. Choose SAMPL, and it lists items M1 to R12 with the passage that appears to report each, or "check by hand" when it finds none. It costs 5 credits per 10,000 words. The check drafts the checklist; you confirm it, and it does not guarantee a journal's acceptance. More: reporting guideline checker.
  • Data Lab runs the tests themselves. The statistics are calculated in your browser, not generated by the AI, and free. Each result comes with an effect size (Cohen's d, η², r or Cramér's V) and an APA 7 sentence, and the "Which test?" chooser includes a reporting template. Not every result shows a confidence interval, so add the CIs SAMPL asks for where they are missing. An AI write-up of the results section costs 2 credits; check it against the table above.

The Free plan has 45 credits a month; see pricing.

Learn more