Quality Magazine logo
search
cart
facebook twitter linkedin youtube
  • Sign In
  • Create Account
  • Sign Out
  • My Account
Quality Magazine logo
  • NEWS
  • PRODUCTS
    • FEATURED PRODUCTS
    • SUBMIT YOUR PRODUCT
  • CHANNELS
    • AUTOMATION
    • MANAGEMENT
    • MEASUREMENT
    • NDT
    • QUALITY 101
    • SOFTWARE
    • TEST & INSPECTION
    • VISION & SENSORS
  • MARKETS
    • AEROSPACE
    • AUTOMOTIVE
    • ENERGY
    • GREEN MANUFACTURING
    • MEDICAL
  • MEDIA
    • A WORD ON QUALITY PUZZLE
    • EBOOK
    • PODCASTS
    • VIDEOS
    • WEBINARS
  • EVENTS
    • EVENT CALENDAR
    • IMTS
  • DIRECTORIES
    • BUYERS GUIDE >
      • Supplier Insights
    • NDT SOURCEBOOK
    • VISION & SENSORS
    • TAKE A TOUR
  • INFOCENTERS
    • Digital Quality Management Systems
    • NEXT GENERATION SPC & QUALITY ANALYTICS
  • AWARDS
    • ROOKIE OF THE YEAR
    • PLANT OF THE YEAR
    • PROFESSIONAL OF THE YEAR
  • MORE
    • Expert Columns
    • NEWSLETTERS
    • QUALITY STORE
    • INDUSTRY LINKS
    • SPONSOR INSIGHTS
  • EMAG
    • eMAGAZINE
    • ARCHIVES
    • CONTACT
    • ADVERTISE
  • SIGN UP!
Software

Software & Analysis

Don’t Touch That Process-Improvement Dial!

Despite your best intentions, you cannot improve a process without first differentiating between common and special causes.

By Paul Keller
Realistic round relay. Metal button that is spinning isolated on a white background.

Image Source: Ivan Sherstiuk / iStock / Getty Images Plus via Getty Images

March 21, 2024
✕
Image in modal.

In most production environments, machine operators are responsible for taking samples to monitor the process and empowered to make process adjustments to keep the line running and product flowing. In many cases, they can be reprimanded if they neglect to react to variation in the process. What if the better strategy is to ignore this data and keep chugging along, with no adjustments to the process?

First, let’s discuss our expectations when we sample from a process. Deming outlined his red bead experiment over 40 years ago in his seminal text Out of the Crisis (Massachusetts Institute of Technology, 1982). Imagine a large bucket of beads, mostly white beads with a scattering of red beads well mixed in the bucket. Deming often did this experiment in his seminars, and he would explain that The White Bead Company sells white beads to their customers. He would ask audience members to collect a sample of beads by dipping a paddle with 50 pre-drilled holes, each the right size to capture a bead, into the bucket. An example of possible results is shown in Figure 1, which plots the percentage of red beads collected in each sample (by a given participant). Note first that the number of red beads varied with each participant’s sample. Deming chastised those with a relatively large number of red beads in their sample (“Customers don’t pay for red beads; you’ll be docked pay!”) and congratulated those with a smaller number (“This employee is management material!”). It was all good fun, yet ludicrous, as each participant had zero effect on the number of red beads in their sample. And that was one of Deming’s points: It is ridiculous to grade employees for actions that they have no control over, such as the process design, the equipment, the raw materials, and so on.

Software feature Figure 1: Red Bead Experiment chart
Figure 1. Control Chart of Deming’s Red Bead Experiment (From Quality America’s SPC IV Excel software)

For our purposes here, the samples provide another lesson: Each time we sample from the bucket, we got a different estimate of the percent of red beads, even when the bucket was not changed. Said differently, since the sampling from the bucket is a repeatable process, we should expect to see variation in the sample results, even if that process is unchanged. And when results vary, it does not necessarily mean the process has changed.

If the sample result alone does not tell us the process has changed, how do we know when the process has changed and requires adjustment? Fortunately, there is a tool designed specifically for this purpose by Walter Shewhart, which has been used extensively for over 100 years: the Statistical Process Control (SPC) chart, aka control chart, process control chart or process behavior chart. A properly designed SPC chart will differentiate between those random fluctuations (aka common causes of variation) that are built into a process, and sporadic sources of variation that exceed that expectation. (Shewhart called these assignable causes. Deming referred to them as special causes, acknowledging “the word to use is not important, the concept is…” (Deming, pg.310)).

The concept of detecting a real change in the process implies that time is an important element, as change is something that occurs over time, based on differences between one time frame and the next. Likewise, a process refers to a repeatable set of conditions and activities that occur time after time. A process control chart is always presented with data flowing from the earlier time to the next, so that the variation in the samples from the repeatable process is readily apparent (graphically) and can be conveniently estimated (statistically) over each short time frame.

Shewhart defined the statistical formulas used to calculate the expected variation in the samples, and these are shown in Figure 1, labelled UCL (upper control limit) and LCL (lower control limit). Statistical control limits provide several benefits:

  1. Most importantly, statistical control limits provide an operational definition of a special cause: A special cause is present if the sample value is outside the statistical control limits. Think of that old (adapted) Sesame Street lyric: This sample is not like the others; this sample just doesn’t belong. The interpretation of the control chart is that simple.
  2. When there are no instances of special cause present, the area between the control limits provides the expected behavior (i.e. our prediction) of the process for the future. In Figure 1, the control limits indicate we should expect the percent of red beads in any sample to be less than 22%. We can use this for planning purposes, such as in budgeting and process capability analysis.
  3. Statistical control limits provide a decision rule for action.
     a. When only common causes are present, then no action should be taken based on the value of any current sample. We ignore the sample-to-sample variation within the control limits. If the current process is undesirable, we need to redesign the process to reduce common cause variation.
     b. When a special cause occurs, then we act to determine the conditions currently present that have influenced the process to behave differently. If the new behavior is undesirable, we should seek to remove the condition responsible. If the new behavior is favorable, we should look to standardize on this new condition as a means of process improvement.
  4. Control limits provide a statistical basis for the Run Test rules, developed initially by Western Electric as an improvement to the control chart. These Run Test rules provide improved detection of special causes, primarily by looking for patterns in the data within the control limits that are statistically unlikely to occur unless a special cause is present. While these are more cumbersome to use in a paper-based system than the simple comparison to the control limits, when you’re using SPC software to monitor your process, these can be automatically applied for a no-hassle benefit to the chart.

What happens if you’re not using a control chart and you respond to common cause variation as if it were a special cause and adjust or change the process? Deming discussed this using his funnel experiment (Deming, 1982), where he would mark a target on a flat table, then drop a marble from a funnel onto the table from a designated height and note the difference from the drop point to the target. Adjust the process using one of four strategies, and repeatedly use this same strategy for 50 drops. His four adjustment strategies, examples of their use and their results are as follows:

  1. Strategy 1: No adjustment to the funnel position. This is the same strategy described for the control chart, where no adjustment is made when the process is influenced by only a common set of conditions. This results in a stable distribution of points, with the minimum possible amount of variation.
  2. Strategy 2: Adjust the funnel position by moving it from the current position toward the target by the amount equal to the difference between the drop point and the target. This is the most common strategy for process adjustment and is illustrated in Figure 2. This occurs when you try to “control” the process using specifications rather than statistical control limits. This tampering with the process results in a stable distribution of points, but with twice the variance experienced via Rule 1. (Mathematically, it can be shown the variance is doubled, which results in the process standard deviation increasing by 40%). In other words: You’ve just increased your defect rate substantially!
  3. Strategy 3: Adjust the funnel position by moving it the opposite direction, a distance from the target equal to the difference between the drop point and the target. For example, the most recent data was 20 units above target, so adjust the process by -20 so it will now be on target. This results in ever-increasing (unstable) movement of the process from target, oscillating in one direction then the other.
  4. Strategy 4: Adjust the funnel to position it directly over the last drop point. This strategy is more common than you might imagine, with examples cited by Deming including operators who try to reduce variation by making the next piece like the last, or managers who train workers using the recently trained as trainers. This also results in an unstable, ever-increasing movement of the process from target in one direction. This is known statistically as the random walk, which is often described by the metaphor of a drunk trying to walk home, falling at each step, and restarting the next step in a random direction, going further and further off course with each step. Doesn’t end well for the drunk either.
Software feature Figure 2 The Effects of Tampering
Figure 2. The Effects of Tampering.

Wheeler recently wrote of the applications of several funnel-type adjustment strategies as they relate to the use of automated PID controllers (Can We Adjust Our way to Quality, Parts 1 & 2, Quality Digest). Many engineers incorrectly surmise that these automated techniques are superior to manual techniques in somehow preventing the entirely predictable increase in process variation due to unnecessary adjustments (noted as Strategy 2, above). Unsurprisingly, his conclusions mirrored Deming’s: The no-adjustment strategy achieves the least variation, whether the process is influenced by common cause variation only or influenced by both common and special causes.

It should be clear that the control chart provides the means to learn about our process.

In fact, it is the fundamental tool of process analysis. No other statistical tool, such as confidence intervals, can be used to estimate process variation, as those tools ignore the element of time, a fundamental aspect of a process. This is the power and exclusive domain of the control chart, which is a necessary precursor for every process improvement activity. Despite your best intentions, you cannot improve a process without first differentiating between common and special causes, as your reaction to each must be different. You cannot effectively implement Lean without the predictability provided by a controlled process. As Deming said: “The distribution of a quality-characteristic that is in statistical control is stable and predictable, day after day, week after week. Output and costs are also predictable. One may now start to think about Kanban or just-in-time delivery.” (Deming, pg. 333).

KEYWORDS: analysis continuous improvement manufacturing metrology process control software & analysis

Share This Story

Looking for a reprint of this article?
From high-res PDFs to custom plaques, order your copy today!

Paul Keller is president of Quality America, a publisher of software and training for Six Sigma Quality Improvement. He has written several books, including SPC Demystified (McGraw Hill, 2011) and the third, fourth and fifth editions of The Six Sigma Handbook (McGraw Hill, 2009, 2013, 2018). For more information, email [email protected] or visit www.qualityamerica.com.

Recommended Content

JOIN TODAY
to unlock your recommendations.

Already have an account? Sign In

  • 2024 Quality Rookie of the Year Justin Wise 1440x750px banner with "Quality Rookie of the Year" logo inset

    Meet the 2024 Quality Rookie of the Year: Justin Wise

    Justin Wise is an exceptional individual who has been...
    Aerospace
    By: Michelle Bangert
  • Man with umbrella and coat stands outside while it rains at night looking at a building.

    Nondestructive Testing: Is there an ethics problem?

    I was a whistleblower who exposed fraudulent activities...
    NDT
    By: Dale Norwood
  • Unraveling Deflategate: Football stadium with closeup of football on field

    Unraveling the Tom Brady Deflategate

    The Deflategate scandal erupted following the 2014 AFC...
    Measurement
    By: Greg Cenker and Henry Zumbrun
Manage My Account
  • eMagazine Subscriptions
  • Newsletters
  • Online Registration
  • Subscription Customer Service
  • Manage My Preferences

More Videos

Sponsored Content

Sponsored Content is a special paid section where industry companies provide high quality, objective, non-commercial content around topics of interest to the Quality audience. All Sponsored Content is supplied by the advertising company and any opinions expressed in this article are those of the author and not necessarily reflect the views of Quality or its parent company, BNP Media. Interested in participating in our Sponsored Content section? Contact your local rep!

close
  • Key Takeaways for Quality Leaders
    Sponsored byComplianceQuest

    Key Takeaways for Quality Leaders from the 2026 Gartner Magic Quadrant™ for QMS

  • This image shows a person seated next to a Bobcat T66 compact track loader.
    Sponsored byPolyWorks by InnovMetric

    Supercharging Digital Gauging at Bobcat North America

  • Dorsey Calibration Lab photo by Tom LaBarbera Picture this Studios
    Sponsored byDorsey Metrology International

    Ensuring Product Quality in a Competitive Manufacturing Landscape

Popular Stories

This image shows a person seated next to a Bobcat T66 compact track loader.

Supercharging Digital Gauging at Bobcat North America

Dorsey Calibration Lab photo by Tom LaBarbera Picture this Studios

Ensuring Product Quality in a Competitive Manufacturing Landscape

a professional in the aviation field performing maintenance, repair, and overhaul (MRO) work

Manufacturing Retention: Strategies for Improving Company Culture, Engagement and Skill Development

2026 Quality Professional of the Year!

Events

June 22, 2026

Automate 2026

Automate is North America's largest robotics and automation event — and the best place to take your ideas from insight to impact.
 
Our show floor features the world’s leading automation solutions, from AI and robotics to motion control, vision systems, and more. Plus, our educational conference is second to none, led by the brightest minds in automation today.
 
Ready to transform the way you work? Take the next step at Automate.
July 14, 2026

Quality Leaders Forum: Better Communication, Better Quality Data

The Quality Leaders Forum is a quarterly, editor-moderated fireside chat series hosted by Quality Magazine, featuring candid conversations with senior manufacturing and operations executives shaping enterprise-level quality.

View All Submit An Event

Products

Lean Manufacturing and Service Fundamentals, Applications, and Case Studies

Lean Manufacturing and Service Fundamentals, Applications, and Case Studies

See More Products
Quality Podcast Channel Custom Content

Related Articles

  • QM 1122 Software & Analysis SPC Software Feature

    SPC Software Enables Real-Time Process Management

    See More
  • SPC Software

    How to Statistically Control the Process

    See More
  • Electronics Design Factory: Male Engineer Wearing Safety Vest Working on Computer.

    Adding Confidence to Your Capability Estimates

    See More

Related Products

See More Products
  • The Process Improvement Handbook: A Blueprint for Managing Change and Increasing Organizational Performance

  • Streamlined Process Improvement

  • Strategic Continuous Process Improvement

See More Products

Related Directories

  • Chicago Dial Indicator Co.

    For more than 80 years CDI has been a trusted supplier of dial indicators, contact points, depth bases, thickness gages, and granite stands for major manufacturers and OEMs across the globe. Along with more than 400 standard mechanical dial indicators and electronic dial indicators we also have the expertise to meet your special gaging requirements including special mounting backs, special contact points, and custom mechanical and electronic dial indicators.
  • Symphony Technologies

    Symphony Technologies: Software for Product and Process Quality Improvement: Simple, user-friendly and powerful software that helps you to design better products and improve your process performance. Software for FMEA, SPC, MSA, Process Capability, Pre-Control & Web-based GD&T Training.
  • MAN/T&P

    Modern Applications News (MAN) and Tooling & Production (T&P) are industry-respected, monthly electronic eNewsletters with a combined circulation of more than 90,000 qualified machine tool/metalworking professionals. MAN's target market is the high-tech job shop, OEM and contract manufacturer in both machining and fabricating environments. T&P targets large OEMs.
×

Stay in the know with Quality’s comprehensive coverage of
the manufacturing and metrology industries.

Newsletters | Website | eMagazine

JOIN TODAY!
  • RESOURCES
    • Advertise
    • Contact Us
    • Directories
    • Manufacturing Division
    • Store
    • Want More
  • SIGN UP TODAY
    • Create Account
    • eMagazine
    • Newsletters
    • Customer Service
    • Manage Preferences
  • SERVICES
    • Marketing Services
    • Market Research
    • Reprints
    • List Rental
    • Survey/Respondent Access
  • STAY CONNECTED
    • LinkedIn
    • Facebook
    • YouTube
    • X (Twitter)
  • PRIVACY
    • PRIVACY POLICY
    • TERMS & CONDITIONS
    • DO NOT SELL MY PERSONAL INFORMATION
    • PRIVACY REQUEST
    • ACCESSIBILITY

Copyright ©2026. All Rights Reserved BNP Media, Inc. and BNP Media II, LLC.

Design, CMS, Hosting & Web Development :: ePublishing