Morrow CreekData Services
← Morrow Creek Data Journal

How to Build a Data Lineage Map for a Business Metric

Morrow Creek Data ServicesMorrow Creek Data Journal

A dashboard number can look precise while leaving basic questions unanswered. What does it include? Which date determines the reporting period? Which refresh produced it? If a source field changes, which reports and decisions move with it?

A metric lineage map answers those questions for one business number. It traces the metric from source data through the rules and calculations that shape it, then forward to the reports, alerts, and decisions that depend on it.

Do not begin by trying to diagram the entire data estate. Start with a metric that matters: monthly net revenue, on-time delivery rate, active customers, or another number used to make a consequential decision. A compact map that people can read and maintain is more useful than a vast diagram nobody can explain.

Start with the published number

Begin where decision-makers encounter the metric: a dashboard tile, report table, spreadsheet cell, or API output. Record its name, location, reporting cadence, and the team that uses it.

Then create a short metric card before drawing arrows. At minimum, include:

  • business purpose and decision supported
  • accountable owner
  • formula and unit
  • grain, or the level represented by each record
  • reporting period and date rule
  • inclusion and exclusion rules
  • expected refresh schedule
  • known caveats, including whether historical values can change

Consider a metric called Monthly Net Revenue. Its formula might be recognized invoice amount less approved credits. That still is not a complete definition. The card should also say whether tax, voided invoices, and intercompany charges are excluded; whether revenue follows invoice, fulfillment, or recognition date; and whether late credits can restate prior months.

Those details are where two apparently identical numbers often diverge.

Draw a map with useful layers

A lineage map should connect both the logical definition and the physical path. A practical set of node types is enough for most first versions:

  • Published metric or output: the dashboard, report, or export people use.
  • Metric definition or calculation: the approved formula and business rules.
  • Curated model or table: the prepared dataset used for reporting.
  • Transformation process: the query, workflow, or other step that changes data.
  • Raw source: the operational system or source dataset where records originate.
  • Control point or owner: the person or team responsible for a material definition, source, or process.

Put the business-facing view first. It should let a manager see what the metric means, where it comes from, and who can answer questions. Add technical detail only where it affects interpretation, reproducibility, or change risk.

A simple upstream path for Monthly Net Revenue might look like this:

Invoice ledger + credit-memo ledger → eligibility and effective-date rules → currency conversion → revenue-recognition model → monthly aggregation → certified metric → executive dashboard

The arrows matter as much as the boxes. Label each connection with a rule or action, rather than leaving it as an unexplained line. For example:

  • “filters to posted invoices”
  • “excludes voided and test records”
  • “joins approved credits by invoice ID”
  • “converts local currency using month-end rates”
  • “aggregates by legal entity and calendar month”

A table name shows where data was. A rule label explains why the answer changed.

Capture the rules that can change the answer

For every material transformation, capture five things: input grain, join key, filter or population rule, time logic, and calculation or aggregation.

These questions expose common weaknesses quickly. Are orders joined to refunds by order ID, customer ID, or something else? Is a customer counted at account level or contact level? Does the metric use event date, accounting date, extraction date, or processing date? Does a status change revise history?

Make time explicit. For a reported value, record the business period represented, the source date used for inclusion, the processing or refresh time, and the relevant time zone. If late-arriving records or corrections can revise historical periods, state that on the map.

Use column-level lineage selectively. It is especially valuable for numerator and denominator fields, date fields, status fields, filters, join keys, and currency or unit conversions. At other points, table-level lineage may provide enough orientation without turning the diagram into a thicket of field names.

Trace downstream, not just upstream

Lineage is often drawn only backward, from a report toward source systems. That helps with investigation, but it misses a major use: impact analysis.

For each metric, list the downstream dashboards, recurring reports, alerts, exports, models, and operating decisions that use it. A change to customer_status_code, for example, might affect an eligibility model, an active-customer metric, a sales-capacity dashboard, a weekly forecast meeting, and an incentive report.

Now a proposed source change has practical questions attached: Who needs notice? Which reports need retesting? Could an earlier period change? Who approves the revised definition?

Ownership belongs on the map as well. Assign an accountable person or team to the metric definition, each material source, and each consequential transformation. Ownership means responsibility for answering questions and approving changes, not merely having access to a system.

Validate it against a real reported value

A map is not proof that a metric is correct. It documents derivation and dependencies; reconciliation, data-quality checks, and review of business rules still matter.

Test the first version in two ways. First, choose a recently published value for a fixed period and try to reproduce it using the documented definition, source history, transformation logic, and approved exclusions. Preserve the relevant report identifier or export alongside the test.

Second, pose a change question: if a particular source field, join key, or filter changes, which published outputs and decisions are affected? If the team cannot answer either exercise, the map is incomplete in a useful, actionable way.

Keep evidence with the map: links to report definitions, transformation logic, source documentation, test results, and the date each element was last confirmed. A polished diagram without a confirmation date can become stale surprisingly quickly.

A spreadsheet, whiteboard, diagramming tool, or data catalog can all support a first map. Begin manually with one high-consequence metric. Automation can later collect technical dependencies, but generated lineage should be treated as evidence to review, not as a substitute for business definitions and judgment.

Update the map whenever the definition, source, refresh schedule, join key, material filter, transformation, or downstream use changes. Review high-stakes metrics on a regular schedule. The result is not just documentation. It is a practical way to explain a number, recreate it for a stated period, and anticipate the consequences of changing it.

Have a dataset that needs to become usable?

Morrow Creek Data Services handles paid research, cleanup, verification, and structured delivery projects.

Start a data project