In 1975, the British economist Charles Goodhart wrote that any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes. Marilyn Strathern later simplified this into the form most people know: when a measure becomes a target, it ceases to be a good measure. If you have spent any time in manufacturing quality, you have lived this law. You just did not have a name for it.
You set a scrap rate target, and your inspectors start reclassifying borderline dimensions as within specification. You tie bonuses to OEE numbers, and suddenly every minute of unplanned downtime becomes scheduled maintenance. You track first-pass yield, and your team discovers that rework does not count as a failure if they never formally document the defect in the first place.
The measure did not break. Your organization broke the measure. It did so with the best of intentions, using the systems you designed, following the incentives you created. This is Goodhart's Law in action on the factory floor, and understanding its mechanics is critical to improving how your organization thinks about quality.
Why Manufacturing Is Highly Vulnerable to Metric Decay
Manufacturing organizations are measurement-obsessed by necessity. You run processes with tight tolerances, IATF 16949 and AS9100 regulatory requirements, customer specifications, and audit standards that demand numerical evidence of compliance. The entire quality management system, from incoming inspection to final audit, is built on the assumption that if you measure the right things and hit the right numbers, good quality follows.
This assumption is not entirely wrong. Measurement is essential. Targets are essential. Without them, you have no way to know whether your processes are stable, improving, or quietly falling apart. But Goodhart's Law describes the gap between measuring to understand and measuring to hit a number. That gap is where most of your hidden quality problems live and multiply.
The stakes are real and the pressure is immediate. When metrics are tied to performance reviews, bonuses, or customer scorecards, people optimize for the metric, not for the underlying quality the metric was supposed to represent. This is not dishonesty. It is rational behaviour in a system that rewards the wrong outcome. If you tie a supervisor's bonus to a specific Cpk, they will find a way to deliver that number.
Furthermore, quality measurements are complex and interpretable. Unlike a simple count of units produced, most quality metrics involve judgment calls. Is that scratch a cosmetic defect or within specification? Does that dimension fall inside the tolerance band if you measure it at a slightly different angle? Where there is interpretation, there is optimization. Where there is optimization under pressure, the measurement degrades.
The Anatomy of Metric Collapse
Goodhart's Law does not happen overnight. It follows a predictable pattern, and if you know what to look for, you can catch it before it causes real damage. A quality metric is introduced with genuine intent. Maybe it is a first-pass yield target of 98 percent. At first, the measurement is honest. Defects are logged accurately, the number reflects reality, and the organization uses it to make real process improvements.
Then management decides this metric should be a target. It goes on the weekly dashboard. It is discussed in the production meeting. It gets tied to shift performance or individual evaluations. At this point, the metric is still mostly honest. But the pressure has begun, and the optimization starts. People make small, defensible adjustments that happen to make the number look better. An inspector classifies a borderline defect as within spec. A supervisor codes a downtime event as planned maintenance.
Eventually, the metric uncouples from reality entirely. The first-pass yield dashboard says 98.5 percent, but the customer return rate tells a completely different story. The measure has collapsed. It is still a number on the dashboard, but it no longer measures quality. It measures the organization's ability to produce that specific number. When the crisis finally hits, the investigation always goes the same way. The numbers looked fine, but the quality was eroding the entire time.
The Lifecycle of Metric Collapse
- 01Honest MeasurementA new KPI is introduced. Data collection is accurate and reflects the actual process.
- 02Target PressureThe metric moves to the main dashboard and is tied to evaluations or bonuses.
- 03Rational OptimizationStaff make small, defensible classification adjustments to protect the number.
- 04UncouplingThe metric no longer reflects reality. The dashboard shows success while quality erodes.
- 05CrisisA customer audit or warranty spike exposes defects the internal dashboards missed entirely.
Classic Examples of Goodhart's Law in Quality Systems
I have audited plants where the scrap rate looked exceptional, only to find that operators were reworking parts before they could be formally scrapped. You set a scrap rate target of less than two percent. Your teams discover that if they rework a defective part before it enters the system, it does not count as scrap. The scrap rate drops to 1.3 percent and everyone celebrates. But rework costs have tripled, cycle times have increased, and the reworked parts have higher failure rates in the field. You hit the target. You missed the point.
Consider the customer complaint metric. You track complaints per thousand units shipped. The number looks great, under 0.5, best in class. But your customers have stopped complaining because they have learned your response process is so bureaucratic and slow that it is not worth the effort. Instead, they have quietly started sourcing from your competitor and will switch at the end of the contract. Your metric did not measure satisfaction. It measured tolerance for paperwork.
The same applies to internal audit findings. You track the number of findings per audit as a measure of quality system health. The number trends downward and management is pleased. But the reality is that your internal auditors have learned that findings create corrective action paperwork for their own departments. So they have gotten more selective about what they write up. The audit findings decreased. The actual nonconformances did not.
Training completion rates suffer the same fate. You track training completion as a percentage. It sits at 99.7 percent. But the training consists of clicking through a slide deck in three minutes and checking a box. The employees who completed the training could not pass a basic competency test on the material. You measured completion. You did not measure competence. The metric became the target, and the target was gamed.
Designing Quality Systems That Resist Goodhart's Law
The uncomfortable truth is that Goodhart's Law is not a failure of the people being measured. It is a failure of the people doing the measuring. When you set a target without understanding the behaviours it will drive, you are not managing quality. You are managing a number. The people who work for you are smart, resourceful, and motivated. They will figure out how to succeed within the system you built. If the system rewards hitting the number, they will hit the number.
If the metric and quality have diverged, the fault lies in the system's design, not in the people operating within it.
This is particularly dangerous in organizations with strong performance cultures. The more seriously people take their metrics, the more pressure they feel to optimize those metrics, and the faster Goodhart's Law takes effect. Apathetic organizations are actually somewhat protected because nobody cares enough about the metrics to optimize them. It is the high-performance plants, the ones driven by continuous improvement, that are most at risk.
You cannot eliminate Goodhart's Law. It is not a bug you can fix. It is a structural feature of any measurement system tied to human behaviour. But you can design your quality metrics to be more resistant to it. This requires building specific defence mechanisms into your quality management system. The goal is to make gaming the metric harder than actually improving the process.
Defence Mechanisms for Your Metrics
Never rely on a single metric to capture something as complex as quality. If you are tracking first-pass yield, also track rework hours, customer returns, warranty costs, and inline defect rates. When one metric starts to diverge from the others, that is your early warning sign that Goodhart's Law is at work. If five independent metrics all point in the same direction, you can be reasonably confident you are measuring reality. If one shows dramatic improvement while the others are flat, you are measuring optimization.
Rotate and randomize your measurement points. If people know exactly when and how they will be measured, they can optimize for that specific window. Some of the most effective quality systems build in unpredictability through random sampling times, rotating audit schedules, and unannounced Gemba walks. This is not about catching people doing things wrong. It is about making it impossible to game a single, predictable measurement window.
Single-Metric Vulnerability vs Overlapping Measurement
Single-Metric Target
- Teams optimize the specific definition of the metric.
- Borderline defects are reclassified to protect the number.
- Rework and hidden waste increase while the target looks green.
- Management only sees the dashboard, missing the floor reality.
Overlapping Metrics
- FPY is cross-checked against rework hours and inline scrap.
- Customer complaints are measured alongside warranty costs.
- Diverging trends immediately flag potential metric gaming.
- Forces teams to improve the actual process, not the paperwork.
Separate measurement from consequences. The people collecting quality data should not be the same people whose performance is evaluated based on that data. The inspector who finds defects should not report to the supervisor whose metrics depend on low defect rates. The auditor who writes findings should not be in the same management chain as the process owner being audited. Independence of measurement is a fundamental auditing principle precisely because it is a Goodhart defence.
Track behaviour, not just outcomes. Instead of measuring defect rate alone, measure whether people are following the documented process correctly. Instead of measuring training completion, measure whether operators can demonstrate competency on the actual equipment. Instead of measuring the number of 8D corrective actions closed, measure whether the specific problems actually recurred. Outcome metrics are easier to game because outcomes can be reclassified. Behavioural metrics are harder to fake.
The Dashboard Test and the Deeper Lesson
Run a simple exercise. Look at your primary quality dashboard. For each metric on that board, ask yourself two questions. First, if someone wanted to make this number look better without actually improving quality, could they do it? Second, would anyone notice? If the answer to the first question is yes and the answer to the second is probably not, you have a Goodhart problem. That metric is no longer measuring quality. It is measuring your organization's ability to produce that metric.
The single most powerful accelerator of Goodhart's Law is fear. When people are afraid that a bad number means a lost bonus or a public shaming in the production meeting, they will find ways to make the number look better. This is not a character flaw. It is a survival instinct. The organizations most resistant to metric collapse are the ones where bad numbers trigger curiosity rather than punishment. A rise in defect rate should prompt a question about what the process needs, not who needs to be blamed.
Goodhart's Law is ultimately about the relationship between maps and territories. Your quality metrics are a map. The actual quality of your products, processes, and systems is the territory. The map is essential. But when you start managing the map instead of the territory, you get lost while convinced you know exactly where you are. The best quality professionals use metrics constantly but never forget that the metric is a proxy, not the thing itself.
Cross-reference your data. Go to the Gemba and look with your own eyes. Maintain a healthy skepticism about numbers that look too good and improvements that come too fast. The most dangerous moment in quality management is not when your metrics show a problem. It is when your metrics show everything is fine and you believe them without checking. The manufacturing world keeps proving Goodhart's law. The only question is whether your organization will learn it before the next crisis teaches it.