Skip to content
Matthew Reda
Go back

Stop Reporting ROI to Four Significant Figures

Edit page

If your model’s effect is uncertain to ±10% or worse, stop printing it as 2.347. Every digit you write down is a claim about precision, and three of those four are claims your model can’t back. An ROI of “2.347x” says you’ve pinned the answer to a tenth of a percent. An interval of, say, 2.1 to 2.6 says you’ve pinned the first digit and you’re guessing at the second. Those two statements cannot both be on the slide, and the second one is the truth.

This is the cheapest mistake in measurement and one of the most common, because the extra digits cost nothing to produce. The machine computes 2.34719 whether or not any of it is meaningful — it always returns a number, at full floating-point width, with no sense of how much of that width it earned. Rounding to the precision you actually have is a manual act of honesty, and skipping it is the default. So the default is false precision.

The reason it matters isn’t pedantry about sig figs. It’s that digits are how numerate readers gauge confidence. Show someone 2.3 and they hear “roughly two and a third.” Show them 2.347 and they hear “we measured this carefully.” You’ve made a claim about the quality of your evidence using nothing but trailing decimals, and if the underlying interval is ±10% that claim is false. The number didn’t get more certain when you typed more of it; it just started lying about how certain it was.

The worst version — and the common one — is reporting the point estimate with no interval at all. A bare 2.347 is false precision with the evidence that would puncture it removed from the room. At least 2.347 (95% CI: 2.1–2.6) contains its own correction; a reader can see the spread swallow the trailing digits and discount them. Strip the interval and you’ve kept all the implied confidence and deleted the part that says how much to trust it. That’s not simpler reporting. It’s the same overstatement with the receipts hidden.

The fix is a one-liner you can adopt today:

Reporting fewer digits feels like you’re admitting weakness. You’re not — you’re declining to fake strength you don’t have. The number 2.3 (±0.25) is a more impressive piece of work than 2.347, because it’s true, and everyone competent in the room can tell the difference.


Companion to The Assumptions Are the Model: the interval is silent on whether your assumptions held, but at minimum it shouldn’t be silent about the sampling uncertainty you do know how to quantify.


Edit page
Share this post:

Previous Post
Read the Diagnostics First
Next Post
The Assumptions Are the Model