Quality
and the Illusion of Control: When Your Organization Confuses Activity
With Effectiveness — and the Quality Dashboards That Make You Feel in
Charge While the Process Runs Itself Off a Cliff
The dashboard glowed green. Every KPI in the acceptable range. Trend
lines pointing in the right direction. The quality manager clicked
through screens with the confidence of a pilot flying on instruments,
confident that what the gauges told him was reality.
Then the customer called. A shipment of 12,000 precision-machined
housings had arrived with bore tolerances so far out of specification
that the entire batch was unusable. Not slightly out. Catastrophically
out. The kind of out that makes you wonder if anyone was actually
looking at the parts.
Someone was looking. They were looking at the dashboard.
The Psychology Behind the
Illusion
In 1975, Harvard psychologist Ellen Langer ran a series of
experiments that would fundamentally reshape our understanding of human
decision-making. She demonstrated that people consistently overestimate
their ability to control events that are actually determined by chance.
In one study, participants who chose their own lottery tickets demanded
significantly more money to sell them back than participants who were
handed random tickets — despite the odds being identical. The mere act
of choosing created a powerful illusion of control.
Langer called it, with characteristic academic restraint, the
“illusion of control.” And while her experiments involved lottery
tickets and games of chance, the phenomenon she identified is arguably
more dangerous in manufacturing than in any casino.
Here’s why: in a casino, the house takes your money. In a factory,
the illusion of control takes your quality.
How the Illusion
Manifests on the Shop Floor
The illusion of control doesn’t arrive with a warning label. It
doesn’t announce itself. It slowly replaces genuine understanding with
the feeling of understanding, and that distinction is the difference
between a quality system that works and one that merely looks like it
works.
The Dashboard Trap
Modern manufacturing facilities are awash in data. SPC charts, OEE
monitors, defect trend lines, capability indices — all displayed in
real-time on screens mounted at every critical workstation. And there is
no question that this data, properly used, is powerful. The problem is
that the data often becomes a substitute for understanding rather than a
tool for it.
I visited a tier-one automotive supplier in Slovakia that had
invested heavily in a state-of-the-art quality dashboard system.
Beautiful interface. Color-coded alerts. Automatic email notifications
when processes drifted. The quality director showed it to me with the
pride of someone showing off a new car.
“How often do your operators respond to the yellow alerts?” I
asked.
He paused. “The yellow ones?”
“Yes. The early warnings before the process goes red.”
“Mostly they wait for red. Yellow happens a lot.”
There it was. The system generated so many alerts that the team had
learned to ignore the ones that mattered. The dashboard created an
illusion of control — the feeling that because the data was visible,
someone was acting on it. But visibility without action is just
decoration. And decoration doesn’t prevent defects.
The Meeting Ritual
Every Monday at 8:00 AM, the quality team gathered. They reviewed the
previous week’s metrics, discussed open corrective actions, and assigned
new ones. The meeting had an agenda, a facilitator, and minutes. It
looked, to any outside observer, like a well-functioning quality
management system in action.
But over the course of three months of observation, I noticed
something troubling. The same problems kept appearing on the agenda. Not
the same type of problems — the same problems. The same root cause
codes. The same corrective actions marked “in progress.” The same
discussions, slightly reworded, producing slightly rephrased action
items that would appear again the following Monday.
The meeting had become a ritual of control rather than an instrument
of it. Participants left feeling that something had been accomplished —
after all, they had discussed the problems, assigned actions, and
documented everything. The illusion was complete. Activity had been
mistaken for progress.
The Documentation Effect
One of the most insidious forms the illusion takes is through
documentation itself. Organizations that have rigorous documentation
systems — control plans, FMEAs, work instructions, inspection records —
often fall into the trap of believing that because something is
documented, it is controlled.
I recall auditing a medical device manufacturer that had, by volume,
the most impressive quality documentation I had ever seen. FMEAs that
ran to sixty pages. Control plans with hundreds of characteristics. Work
instructions with color photographs and step-by-step detail.
During the gemba walk, I watched an operator perform a seal integrity
test. The work instruction specified a test pressure of 2.5 bar for 30
seconds. The operator applied approximately 2.5 bar for approximately 30
seconds. Close enough, right?
The issue was that “approximately” was not in the specification. The
gauge on the test fixture had a resolution of 0.5 bar and no calibration
sticker. The timer was the operator counting in his head. The work
instruction was beautiful. The actual control was nonexistent.
The documentation created an illusion of control so convincing that
nobody thought to question whether the control was real.
The Neuroscience of Why
We Fall for It
The illusion of control persists because it is not a character flaw —
it is a cognitive architecture. The human brain is a prediction machine,
and it interprets the ability to predict as the ability to control.
When you can see a process metric in real-time, your brain constructs
a mental model that includes you as the controller of that process.
You’re not. You’re the observer. But observation feels like control
because both involve attention directed at the process.
This is compounded by what psychologists call the “choice supportive
bias.” When we make choices — selecting a control plan, setting a
tolerance, choosing a sampling frequency — we tend to remember those
choices as better than they actually were. We become invested in our
decisions, and that investment creates a feedback loop: we chose it, so
it must be good, so we must be in control.
The manufacturing environment amplifies this through what I call the
“complexity premium.” The more complex a quality system is — the more
dashboards, meetings, documents, and procedures it contains — the more
control it appears to provide. Complexity becomes a proxy for
effectiveness. And the truth is almost the opposite: the most effective
quality systems I’ve encountered are elegant in their simplicity.
Where the Illusion Does
the Most Damage
Supplier Quality Management
Nowhere is the illusion of control more costly than in supplier
quality. Organizations send auditors to supplier sites, review PPAP
packages, approve control plans, and maintain approved supplier lists.
All of these activities create a powerful sense that the supply chain is
under control.
Then a supplier ships 50,000 nonconforming components. The PPAP was
perfect. The audit report was clean. The control plan was comprehensive.
But between the audit and the shipment, the supplier changed their raw
material source, retrained their operators using a shortened program,
and started running their process 20% faster to meet a delivery
deadline.
The illusion was that the approval process created ongoing control.
In reality, it created a snapshot — a moment in time that was preserved
in documentation while reality moved on.
Process Validation
Process validation is another area where the illusion thrives. The
validation protocol is written, the runs are executed, the data is
collected, the report is approved. The process is validated.
But validation demonstrates capability under controlled conditions.
It does not guarantee performance under the chaotic, variable,
unpredictable conditions of daily production. The validation report sits
in the quality system like a certificate of immortality, and everyone
behaves as though the process is permanently trustworthy because it was
once proven to be trustworthy.
Management Review
Management review meetings are designed to ensure that top management
maintains oversight of the quality system. In theory, this is the
ultimate control mechanism — the people with the authority to allocate
resources reviewing the data that tells them where to allocate it.
In practice, management reviews often become performances of control
rather than exercises in it. The data is presented in formats that
emphasize stability and downplay variation. Problems that were
previously reported are shown as resolved, even if the resolution was
temporary or incomplete. The meeting reinforces the narrative that
management is in control, and that narrative is more comfortable than
the truth.
Breaking the Illusion
The good news is that the illusion of control, once recognized, is
manageable. It doesn’t require abandoning dashboards or discarding
documentation. It requires something much harder: honesty about the
limits of what you can actually control.
Distinguish Monitoring
from Controlling
Every time you look at a dashboard, ask yourself: “Am I controlling
this process, or am I watching it?” If the answer is watching — and it
usually is — then ask what would need to change for you to actually
control it. The answer usually involves going to the gemba, touching the
process, and making decisions based on what you observe rather than what
the screen tells you.
A German automotive OEM I worked with implemented a simple rule: no
quality decision could be made from a dashboard alone. Every decision
required at least one person to physically observe the process in
question. The rule didn’t eliminate dashboards — it repositioned them as
indicators rather than instruments of control.
Audit the Audit
Your quality system is only as good as its weakest verification
mechanism. If you rely on audits to confirm that processes are being
followed, then audit the audit process itself. Are auditors finding real
problems, or are they confirming that documentation exists? Are audit
findings leading to genuine improvements, or are they generating
corrective action paperwork that closes the finding without addressing
the cause?
One pharmaceutical company I advised began sending their most
experienced operators on internal audits instead of their quality
engineers. The operators found problems the engineers had walked past
for years — not because the engineers were incompetent, but because the
operators understood the difference between what the work instruction
said and what the work actually required.
Measure What
You Control, Not What You Can Measure
The easiest things to measure are often the hardest things to
control, and vice versa. Dashboard metrics tend to be selected based on
data availability rather than actionability. If you can’t change a
metric through direct action, don’t put it on a dashboard and pretend
you’re controlling it.
Instead, build dashboards around the things operators and engineers
can actually influence. If an operator can adjust a machine setting,
show them the real-time output of that setting. If an engineer can
change a process parameter, give them data that connects that parameter
to product quality. Connect the information to the action, and the
illusion dissolves into genuine control.
Embrace Uncertainty
The most counterintuitive antidote to the illusion of control is
admitting what you don’t control. Organizations that openly acknowledge
uncertainty — in their processes, their supply chains, their measurement
systems — tend to have better quality outcomes than organizations that
project confidence.
This isn’t about pessimism. It’s about realism. A quality system that
says “we monitor this process continuously and intervene when we detect
drift” is more honest and more effective than one that says “this
process is under control.” The first statement implies vigilance. The
second implies complacency.
The Cost of the Illusion
I’ll leave you with a story. A large aerospace manufacturer had a
first-pass yield of 97.3%. Their dashboards showed this number every
day. It had been stable for eighteen months. The quality team was
satisfied. Management was satisfied. Customers were satisfied.
Then a new quality director arrived and asked a simple question:
“What happens to the 2.7%?”
It turned out that the 2.7% — the parts that failed first-pass
inspection — were being reworked, re-inspected, and shipped. The rework
process had never been validated. The re-inspection used a different
measurement method than the original inspection. And nobody had ever
tracked whether reworked parts had different field performance than
first-pass parts.
The 97.3% first-pass yield was real. But the feeling of control it
provided was an illusion. The 2.7% — the parts they thought they had
handled — were a black hole of unexamined risk.
The illusion of control doesn’t fail spectacularly. It fails quietly.
It lulls organizations into a state of comfortable confidence while
reality accumulates in the gaps between what the dashboard shows and
what the factory floor knows.
The most dangerous quality risk in any organization is not the defect
you can’t see. It’s the defect you think you’ve already handled.
The Path Forward
Recognizing the illusion of control doesn’t mean abandoning your
quality systems. It means using them more honestly. Every dashboard
should come with an implicit question: “What is this not showing me?”
Every meeting should include time for asking, “What are we assuming is
under control that might not be?” Every audit should probe not just
compliance but competence — not just whether the process is documented,
but whether the documentation reflects reality.
The organizations with the best quality records are not the ones with
the most elaborate control systems. They are the ones that maintain a
healthy skepticism about how much control any system can actually
provide. They treat their quality systems as tools, not talismans. They
trust their people more than their dashboards. And they never, ever
confuse feeling in control with being in control.
Your dashboards are instruments, not reality. Your meetings are
conversations, not control. Your documentation is history, not destiny.
The sooner your organization learns to distinguish between the feeling
of control and the fact of it, the sooner your quality system will start
doing what it was always supposed to do: prevent defects, not just
document them.
Peter Stasko is a Quality Architect with 25+ years of experience
transforming organizations across automotive, aerospace, and
pharmaceutical industries. He has helped companies on three continents
build quality systems that work in practice, not just in documentation —
and he still believes the most important quality tool is an honest
question.
