Morrow CreekData Services
← Morrow Creek Data Journal

How to Choose a Comparison Group Before Measuring Business Performance

Zachery Knowles
Zachery KnowlesFounder, F.R.A.R.Y. Data Technologies LLC

A benchmark needs a job description before it needs a number.

Many performance reviews start with a familiar move: pull an industry average, name a few recognizable competitors, and compare revenue growth, operating margin, sales per employee, or another headline measure. The result may look precise, yet answer the wrong question.

An industry average asks, “What is common in this market?” A purpose-built peer group asks, “How are businesses operating under meaningfully similar conditions doing?” Both can be useful. They are not interchangeable.

The first task is to state the decision the comparison will support. A group built to set sales targets may need similar customer types, territories, route density, and sales models. A group used to assess hiring costs may need companies competing in the same labor market. A group for an investment decision may emphasize scale, capital needs, and growth stage instead.

If the decision is unclear, the peer group will usually become a collection of companies someone happens to recognize.

Define what one row represents

Before selecting peers, define the unit being compared. Is it a company, legal entity, establishment, store, branch, territory, product line, or business unit?

This sounds technical, but it changes the meaning of the result. Public business data may describe establishments, which are individual locations, while a management team may be trying to benchmark the entire enterprise. A multi-location company should not automatically be compared with a single-location business just because both carry the same industry label.

The metric needs the same discipline. “Operating margin” should use the same formula, accounting period, and treatment of unusual items across the group. “Sales productivity” needs a stated denominator: all sales representatives, fully ramped representatives, or average full-time equivalents. A peer group cannot rescue a metric that means different things from one business to another.

Start with a candidate universe, then narrow it

Industry and geography are sensible starting points. Government business statistics, for example, can provide broad frames by industry, location, and size. But a same-industry label is rarely a final peer definition.

Choose a short list of conditions that are likely to affect the metric and matter to the decision. Depending on the question, these may include:

  • primary business activity;
  • size or revenue band;
  • geography and labor market;
  • customer segment;
  • direct, partner, franchise, or subcontractor model;
  • business age or maturity;
  • capital intensity; and
  • regulatory conditions.

The aim is not to match every detail. That would produce a tiny, fragile group. The aim is to match the few conditions that make the performance comparison fairer.

Consider a regional commercial cleaning company assessing its operating margin. A national facilities-services benchmark provides useful backdrop. For a management decision, though, a narrower group might include firms with similar contract mix, customer types, local wage conditions, revenue scale, and reliance on subcontractors.

If the company operates mostly in one high-wage city while its peers are spread across lower-cost markets, that difference belongs in the report. A percentile rank without that caveat can look more conclusive than it is.

Set the rules before reading the score

The selection rules should use characteristics known at the start of the period being measured. Do not remove weak performers after results arrive, keep only surviving companies, or revise the definition because a particular business makes the comparison uncomfortable.

This is less about academic formality than basic credibility. A comparison group chosen after seeing the outcome is easily turned into a favorable story.

Write down inclusion and exclusion rules before opening the performance dashboard. A practical peer-group card can include:

  • the decision to be made;
  • unit of analysis;
  • metric formula and time period;
  • candidate universe;
  • inclusion and exclusion criteria;
  • matching characteristics that matter most;
  • data sources and known gaps;
  • weighting method, if any; and
  • version date.

This record also helps when someone asks six months later why a particular business was included or excluded.

Use two frames when one cannot do both jobs

A broad industry benchmark and a narrow operating peer group often belong in the same report. Keep them separate and label them clearly.

For example: “Our margin was 11%. The broad industry reference was 9%. Among 14 businesses selected for similar contract mix, geography, and size, the median was 12%.” This tells a more useful story than blending unlike businesses into one unexplained average.

Report the distribution, not only the midpoint. Include the peer count, the median or other stated center, and the middle half of results, such as the 25th to 75th percentile range. A median can hide a wide spread. If the middle half runs from 6% to 18%, being near the median says something different than if it runs from 11% to 13%.

Small and changing groups need extra caution. One acquisition, closure, or reporting change can move the median. Treat highly specific percentile rankings as directional when the data are sparse, lagged, estimated, or inconsistently defined.

Review without casually rebuilding

Peer groups should be reviewed when a company’s operations, size, ownership, geography, or available data change materially. Continuity matters, too. Frequent undocumented changes make a trend line difficult to interpret.

Date each version of the group and explain what changed. When practical, show whether the conclusion looks different under the prior group. That makes the benchmark more durable and prevents a moving reference set from quietly rewriting history.

Finally, do not mistake comparison for proof. If performance improves after a pricing change, software rollout, acquisition, or leadership shift, a peer comparison can provide context. It cannot establish that the change caused the result.

A useful final test is plain language: can the team explain in one or two sentences why every member belongs in the group? If not, the benchmark is not ready to set a target, support a bonus decision, or guide an operating conclusion.

Have a dataset that needs to become usable?

Morrow Creek Data Services handles paid research, cleanup, verification, and structured delivery projects.

Start a data project