Morrow CreekData Services
← Morrow Creek Data Journal

How to Measure the Cost of Manual Data Review Before Automating It

Morrow Creek Data ServicesMorrow Creek Data Journal

Manual review is often priced with a shortcut: monthly volume multiplied by average minutes per item, then multiplied by a reviewer’s wage. That figure may be quick, but it is rarely decision-ready.

A useful baseline treats review as an operating process. Cases enter, people touch them in different ways, some cases return, and a completed decision may require quality checks or escalation. Measure that process before comparing it with automation. Otherwise, the apparent savings may rest on work that was never counted or on costs that would remain after automation.

Start with a completed unit of work

Define the unit that matters to the business: one application brought to a final decision, one transaction resolved, one supplier record approved, or one alert closed. Avoid “records reviewed” when several records can belong to the same business case.

This choice affects both sides of the calculation. Suppose a team reports 10,000 records reviewed each month. Those records may relate to 6,000 customer cases, with some cases reopened and others reviewed twice. For a case-based process, the denominator is usually final closed cases. Every extra touch still belongs in the numerator because it consumed effort.

Use a plain name for the metric: cost per final disposition. It gives leaders a unit that can be compared across periods and, later, against an automation forecast.

Map the work before timing it

A time study that captures only the primary reviewer will understate the process. Create a case journey from intake through closure, and mark each human touch. Common steps include triage, evidence gathering, follow-up, primary review, second review, escalation, corrections, QA sampling, calibration sessions, administration, and closure.

This is also the point to prevent double counting. If a reviewer’s recorded handling time already includes case notes, do not add documentation as a separate labor line. If supervisory time is included in an overhead allocation, do not add the same time again as direct supervision.

The Government Accountability Office’s cost-estimating guidance emphasizes defined scope, documented assumptions, data collection, and sensitivity analysis. Those habits are as useful for a review operation as they are for a larger program estimate. Rework deserves its own line, not a footnote. A reopened case or correction is paid work required to reach a valid disposition.

Separate active work from waiting

Record active handling minutes separately from elapsed queue time.

Active time supports a labor-cost calculation. Queue time shows how long cases wait for assignment, evidence, approval, or a handoff. Both matter, but they answer different questions. A case sitting untouched overnight does not create eight hours of reviewer labor.

Waiting can still have a business cost: delayed revenue, slower onboarding, missed service commitments, or increased risk. Put that cost in a separate model unless there is a documented and credible way to value the delay. Folding all elapsed time into manual-review labor can make an automation case look stronger than the evidence supports.

Segment the cases that behave differently

One average review time can hide the part of the process that matters most. At a minimum, separate routine clears, routine corrections, ambiguous cases, escalations, and reopened cases.

Routine document checks may close in minutes. Identity conflicts or incomplete submissions may require outside research, a clarification request, and approval. Combining both types into one average makes easy work appear costlier and hard work appear cheaper than they really are.

For each class, collect closed-case volume, total active minutes, median minutes, and an upper-percentile measure of time. The median describes a typical case. The upper-percentile figure exposes the costly exception tail that automation may not eliminate.

A short study can miss seasonal peaks, policy changes, and rare exceptions. State the observation dates and whether the period was typical. Where possible, compare system timestamps with reviewer logs, especially for work such as external research or consultation that may not appear in a workflow system.

Use an employer cost, not a wage rate

Labor is more than stated hourly pay. Use the employer’s fully loaded cost per productive hour when it is available, including relevant benefits, contractor costs, and attributable supervision.

As an external reasonableness check, the U.S. Bureau of Labor Statistics reported average employer compensation costs in June 2026 of $49.46 per hour for civilian workers and $46.89 for private-industry workers. Those figures include wages and benefits, but they are not a substitute for an organization’s own rates. Role, location, shifts, benefit plans, and contractor arrangements can all differ substantially.

A compact formula is:

> Cost per final disposition = (direct review labor + rework labor + QA and calibration labor + attributable supervisory or case-management labor + direct process-tool cost) ÷ final closed cases

Add direct tool or vendor costs once. Do not bury them in labor and then add them again.

Put quality beside cost, not beneath it

A fast process with inconsistent decisions may be cheap only on paper. Track reopen rate, escalation rate, overturns, error categories, and reviewer agreement on a representative QA sample.

Agreement is not proof of correctness. Reviewers can agree on a flawed interpretation. When feasible, compare a sample against a documented policy decision or an independent review. Still, disagreement is useful evidence: it identifies where instructions, source evidence, or reviewer training may be creating variation.

Report the baseline as a range when inputs are uncertain. Show low, expected, and high assumptions for volume, minutes, rework, and loaded hourly cost. Then identify which assumption changes the result most.

Only after this baseline is established should automation enter the analysis. Estimate routine-case coverage, the residual exception queue, monitoring, maintenance, appeals, and any quality change separately. The goal is not to make the current process look expensive. It is to know what it actually costs before deciding which work should be automated and which work still needs human judgment.

*Sources: [U.S. Bureau of Labor Statistics, Employer Costs for Employee Compensation](https://www.bls.gov/ecec/home.htm); [GAO Cost Estimating and Assessment Guide](https://www.gao.gov/products/gao-20-195g); [NIST terminology on repeatability and reproducibility](https://www.nist.gov/pml/nist-technical-note-1297/nist-tn-1297-appendix-d1-terminology).*

Have a dataset that needs to become usable?

Morrow Creek Data Services handles paid research, cleanup, verification, and structured delivery projects.

Start a data project