METHODS / STANDING RULES

The instrument needs rules.

These are the defaults behind every result on this site. Future posts link here rather than quietly changing the standard.

01

RESOLUTION

Measure the noise floor before the comparison.

A difference smaller than the instrument’s variance is not a result. Repeats must match the boundary of the claim: within-session repeats for local comparisons, cross-session samples for claims that cross days or deployments.

02

PEDIGREE

Manipulation-check every run.

Before interpreting an outcome, verify that the intended workload, configuration, and treatment reached the system. A green run proves completion—not experimental validity.

03

PREDICTION

Seal the forecast before revealing the result.

When a model makes a testable prediction, record the range and assumptions before running the confirming experiment. A prediction written after the result is an explanation, not a test.

04

DISCLOSURE

Declare every asterisk.

Hardware, topology, generator model, dataset shape, run duration, exclusions, and known constraints travel with the claim. Caveats are part of the result, not footnotes to hide.

Show enough work that a skeptical operator can reproduce the result, challenge the assumption, or decide that the measurement does not apply to their system.

See the method applied

I publish one measured post a month: get it by email.

No noise. Unsubscribe at any time.