Morrow CreekData Services
← Morrow Creek Data Journal

Good research knows when to preserve uncertainty instead of forcing an answer

Morrow Creek Data ServicesMorrow Creek Data Journal

A team asks a reasonable question: Which customer segment is most valuable?

The tempting response is a ranked list. Segment A first, Segment B second, Segment C third. It looks decisive and fits neatly into a presentation.

But what does “valuable” mean? Trailing revenue, gross margin, renewal rate, expected lifetime value, or strategic fit? Segment A may lead on revenue while Segment B leads on margin and retention. A single ranking does not resolve that disagreement. It hides it.

Good research does not treat uncertainty as an embarrassment to be pushed into footnotes. It makes uncertainty visible in a form that helps people decide what to do next.

Uncertainty is not one problem

Some uncertainty is numerical. An estimate of market demand, cost, or adoption may reasonably be reported as a range. A point estimate says where the analysis landed; the range shows how much that result depends on inputs, measurement limits, or stated assumptions.

Other uncertainty comes from choices that reasonable analysts could make differently. A result might shift when the time window changes, unusual observations are handled another way, or a category is defined more narrowly. That does not make the work invalid. It means the conclusion should be conditional: it holds under these defensible choices, and may not hold under others.

A third kind is a coverage gap. Perhaps public filings confirm 73 locations, while some jurisdictions do not publish current branch-level records. The honest answer is “at least 73,” not an invented total dressed up as completeness.

These cases call for different responses. A numerical range can be useful for an estimate. Conditional language is better for a definition or analytical-choice dispute. An explicit “we do not know” is necessary when evidence is missing or non-comparable.

Trying to turn every gap into a confidence interval can create a misleading appearance of rigor. Formal statistical intervals have specific assumptions behind them. They are not a universal badge for incomplete evidence.

A range needs a reason

Consider a hypothetical market estimate: the addressable market appears to be roughly $40 million to $65 million under a stated customer and geography definition. That range is useful only if readers know what drives it.

Perhaps the main unknown is the share of firms that buy a service externally rather than build the capability in-house. Then the report should say so. It should also state what the range represents and which definitions were used.

An unexplained "$8 million to $12 million" does not automatically communicate care. It may be a well-supported interval, a rough scenario band, or a guess with an impressive-looking spread. Those are not the same thing.

Measurement guidance from NIST makes a relevant reporting point: uncertainty statements should explain what was evaluated and the basis for any probability interpretation. The business equivalent is straightforward. Do not present a range without explaining what varies, why it varies, and what the reader should infer from it.

Find the assumption that could change the call

Sensitivity analysis sounds technical, but its practical question is plain: if this assumption changes, does our recommendation change too?

Take a forecast that reaches break-even in 18 months under a base case. If the project remains viable across an adoption range of 15% to 25%, but fails below 12%, adoption is the assumption worth validating. If labor cost barely affects the result, it deserves less attention.

This is more useful than applying an arbitrary plus-or-minus percentage to every estimate. The U.S. Government Accountability Office cautions that unsupported percentage adjustments are not, on their own, a valid sensitivity analysis. The variation needs a defensible basis.

The same discipline applies beyond forecasts. Test reasonable alternatives in inclusion rules, category definitions, outlier treatment, time windows, matching rules, and denominators. If the conclusion holds across those choices, say that plainly. If one defensible choice reverses the result, report the fragility instead of declaring a winner.

That does not require treating every possible explanation as equally credible. When evidence strongly favors one interpretation, the reporting should reflect that imbalance. Preserving uncertainty is not false balance.

Make uncertainty decision-ready

A short uncertainty note can turn cautious research into usable guidance:

> What we know: [supported finding.] > What remains uncertain: [range, condition, or evidence gap.] > What drives it: [the one to three assumptions or limitations that matter most.] > What remains a sound decision: [an action that makes sense across credible scenarios.] > What would change the decision: [a specific observation, source, or threshold.]

For the customer-segment question, the note might say that Segment B is the stronger priority for retention investment because it leads on margin and renewal rate. Segment A remains the better target for near-term revenue outreach. There is no single “best” segment until leaders choose the criterion that matches the decision.

This structure also prevents research from becoming an excuse to wait for perfect information. The goal is not to eliminate uncertainty before acting. It is to match the scale and reversibility of an action to the uncertainty that remains.

If a weakly evidenced assumption could create major downside, the next step may be a small test, a targeted source check, or a limited pilot rather than a large commitment. If the same action makes sense across the credible range, more precision may not be worth buying.

“The evidence supports a direction, but not a precise ranking” can feel less satisfying than a clean verdict. It is often the more useful answer. It tells decision-makers what they can do now, what they should not claim, and what evidence would genuinely make the next decision better.

Have a dataset that needs to become usable?

Morrow Creek Data Services handles paid research, cleanup, verification, and structured delivery projects.

Start a data project