A dataset is not clean or dirty in the abstract. It is fit, questionable, or unsafe in relation to what someone intends to do with it.
That distinction changes how data-quality work should begin. Instead of opening with a standard checklist—nulls, duplicates, valid formats, acceptable ranges—start with the decision. What action, analysis, or customer interaction will this data support? What could go wrong if a value is missing, stale, misclassified, or attached to the wrong record?
The answers point to the checks that matter.
Public-sector data-quality guidance describes quality as fitness for purpose. That is a useful standard because the same dataset can be adequate for one purpose and inadequate for another. A late optional attribute may have little effect on a weekly sales dashboard. An outdated address may be unacceptable when it will be used for a legally important customer notice.
Work backward from the possible mistake
Consider a file used to assign incoming leads to sales territories. A generic review might confirm that the state field is populated and contains a two-letter abbreviation. Those checks are not useless, but they do not establish that the record can be routed correctly.
The intended use suggests more consequential questions:
- Is the service address present?
- Can it be located reliably enough for territory assignment?
- Does it fall within an active service area?
- Does the assigned territory match that location?
Each question addresses a distinct failure mode. A record could contain a valid state abbreviation while still lacking a usable street address, falling outside the company’s coverage area, or being routed to the wrong region.
This approach also prevents teams from spending equal effort on unequal problems. A contact phone number may be useful, but it is not necessarily critical to a dashboard that compares monthly revenue trends. For that dashboard, complete reporting periods, clear currency units, and visible source-system changes may matter far more.
Pick the dimension that matches the risk
Completeness, validity, uniqueness, consistency, accuracy, and timeliness are all useful lenses. They are not a mandatory scorecard in which every field needs the same attention.
Completeness should mean complete enough for the use at hand, not that every possible field is populated. A market-sizing analysis may need sound geographic coverage, stable business classifications, sensible duplicate handling, and a clear as-of date. It may have little use for a phone number on every business record.
Validity is another common source of false confidence. A postal code can match the expected pattern and still be wrong. A date can fall within an allowed range and still refer to an outdated event. Format and range checks establish conformance or plausibility; they do not, by themselves, prove that a value reflects the real-world fact needed for a decision.
Timeliness also depends on use. A quarterly planning exercise may reasonably use a dataset refreshed monthly. An automated eligibility decision might require much fresher information. The right question is not “How old is this data?” alone. It is “Is this age acceptable for the action we are about to take?”
Set targets around consequences, not appearances
A pass rate is meaningful only when the failures are understood. A dataset-wide result of 99% can conceal a serious issue if the failing 1% is concentrated in a high-value customer segment, a newly added source, or records that trigger a sensitive workflow.
Measure at the grain where harm could occur. That might mean checking results by source, region, customer type, reporting period, or recent load. A strong overall average should not excuse a concentrated weakness that affects an important decision.
Targets should reflect both consequence and safeguards. A field used for optional outreach can often tolerate more exceptions than a field that directs payments, determines eligibility, supports compliance reporting, or makes a public claim. There is no universal percentage that makes a rule “good.”
For each check, define what happens when it fails. Depending on the use, the response may be to block the workflow, quarantine affected records, route them for review, apply a documented fallback, or publish an analysis with a stated limitation. A failed check that produces only another dashboard number has not finished its job.
Keep the reason for each rule visible
A compact worksheet can make quality checks easier to review and maintain. For each rule, record:
- intended use;
- decision or action supported;
- consequence if the data is wrong;
- critical data elements;
- likely failure mode;
- check and pass target;
- measurement slice and date;
- accountable owner;
- response when the check fails; and
- review date.
This documentation matters when a dataset is repurposed. Data suitable for internal exploration may need stronger checks before it supports forecasting, external reporting, automated action, or an AI-assisted customer interaction. The schema may not change, but the consequences can.
Quality assurance is therefore not a final inspection step or a contest to achieve the highest cleanliness score. It is an ongoing effort to connect data conditions to the decisions they influence. Begin with the intended use, identify the mistake that would matter, and test the conditions that make that mistake possible. The resulting checks are usually fewer, clearer, and more useful.
Morrow Creek Data Services handles paid research, cleanup, verification, and structured delivery projects.
Start a data project