Morrow CreekData Services
← Morrow Creek Data Journal

How to Check Whether Business Categories Cover the Full Population Before Reporting Totals

Morrow Creek Data ServicesMorrow Creek Data Journal

A category report can look tidy and still be wrong. A table may show totals for industry, customer type, sales channel, or geography, yet omit some records, count others twice, or combine records that do not share the same unit.

The key question before publishing an additive category total is not “Do these labels seem reasonable?” It is: for the stated population and unit, does every in-scope record contribute once—and only once—to the total?

That standard turns classification from a labeling task into a reconciliation control. It is also narrower than asking whether a dataset covers every real-world business. This check concerns the records already in the analysis and the scope the report claims to describe.

Start with the reporting universe

Write down the denominator before reviewing category logic. A useful scope statement specifies:

  • the reference period;
  • the geography;
  • inclusion and exclusion rules;
  • business status, such as active, closed, or pending;
  • the source population; and
  • the unit being counted.

That last point changes the answer more often than people expect. Is one row a legal entity, establishment, location, transaction, employee, or distinct customer?

For example, U.S. industry statistics generally classify an establishment by its primary activity. One company may operate a factory, warehouse, and headquarters with different activities. An establishment-level industry table therefore cannot be treated automatically as a company-level industry table. The unit in the headline, denominator, and category rules needs to match.

Treat additive categories as a partition

A sound category scheme for an additive report has two properties:

1. Collectively exhaustive: every in-scope unit belongs somewhere. 2. Mutually exclusive: no in-scope unit belongs in more than one category at the level being added.

Statistical classification guidance commonly uses these ideas: categories should cover the defined universe without overlapping. But category names alone rarely accomplish that. “Retail,” “online,” or “services” can mean different things to different analysts.

Each category needs boundary rules. Document what it includes, what it excludes, how borderline cases are handled, and which rule takes priority if more than one rule seems applicable. Record the classification version and effective date as well. A revised taxonomy can change trend comparisons even if the underlying businesses did not change.

Run the exactly-once test

For each in-scope record, calculate the number of reporting categories it qualifies for.

For an additive report, the desired value is exactly one.

  • Zero categories: the record is unassigned.
  • One category: the record is assigned as intended.
  • More than one category: the record is multiply assigned.

The audit should produce counts and shares for the zero and multiple groups, not merely a pass/fail indicator. Small shares can still matter when they hold a large share of revenue, employment, or other reported value.

A compact reconciliation table makes the result visible:

Reconciliation statusRecord countMeasure value, if reported
Overall in-scope population10,000$42.0M
Assigned exactly once9,620$40.8M
Unassigned240$0.9M
Assigned to multiple categories140$0.3M
Excluded by documented rule0$0.0M
Final published additive total10,000*$42.0M*

The asterisk matters. This total is publishable only after the 240 unassigned and 140 multiply assigned records have been resolved under documented rules, or after their treatment is clearly shown in the published result.

Reconcile the measure, not just the rows

A row-count test is necessary but not sufficient. Every record may have one category while the reported revenue or employment total still fails to reconcile.

Common causes include a measure that is missing on some records, a category field filtered differently from the measure, duplicated records introduced during a join, or an aggregation at a different grain. For example, a directory may classify each location once, while revenue is stored at the company level. Adding location categories will not automatically produce a valid company-revenue total.

Compare the overall in-scope measure with the sum of category measures using the same filters, period, unit, and treatment of null values. Investigate any difference rather than rounding it away.

Keep residual states visible

“Unknown,” “Unclassified,” “Other,” “Not applicable,” and blank do not mean the same thing.

A blank may signal a processing failure. “Not applicable” may be a valid state under the category design. “Other” may be a legitimate residual category. “Unknown” is usually a data-status condition, not a substantive peer of named business categories.

A residual category can be the honest way to maintain completeness. The problem begins when it is silently excluded, grows without review, or contains no explanation of what it represents. Include it in the reconciliation and state its size and likely interpretive effect.

Test hierarchy levels separately

Hierarchies create a second source of false totals. At each reporting level, test that every child maps to one parent and that child totals reconcile to the parent total. Also avoid adding parent and child values in the same subtotal.

Consider a product hierarchy where basic, premium, and enterprise plans roll up to subscriptions. If a contract can contain both premium and enterprise components, decide whether the unit is the contract, the component, or allocated revenue. Without that choice, a clean-looking rollup can double count.

Geography works the same way. A location can be summarized by ZIP code, county, or state, but county and ZIP subtotals should not be added together. Each level needs its own valid mapping and reconciliation.

When overlap is intentional, change the presentation

Many useful category systems are deliberately multi-label. A location can be both storefront and online; a customer can use several product lines; a business can fit several marketing audiences.

Do not force these records into a single category merely to make a chart add up. Instead, label the figures as multi-response counts, report a separate distinct-unit total, and state plainly that category totals must not be summed.

The final publication rule is straightforward: publish additive category totals when the unassigned gap is zero, the overlap is zero, and category totals reconcile to the stated overall total. If a residual category remains, include it. If overlap is intentional, present the report as overlapping counts rather than a population partition.

That check will not prove that every source record is correct or that the dataset represents every business in the world. It does establish something essential: the total says what the report claims it says.

Have a dataset that needs to become usable?

Morrow Creek Data Services handles paid research, cleanup, verification, and structured delivery projects.

Start a data project