Quality Magazine logo
search
cart
facebook twitter linkedin youtube
  • Sign In
  • Create Account
  • Sign Out
  • My Account
Quality Magazine logo
  • NEWS
  • PRODUCTS
    • FEATURED PRODUCTS
    • SUBMIT YOUR PRODUCT
  • CHANNELS
    • AUTOMATION
    • MANAGEMENT
    • MEASUREMENT
    • NDT
    • QUALITY 101
    • SOFTWARE
    • TEST & INSPECTION
    • VISION & SENSORS
  • MARKETS
    • AEROSPACE
    • AUTOMOTIVE
    • ENERGY
    • GREEN MANUFACTURING
    • MEDICAL
  • MEDIA
    • A WORD ON QUALITY PUZZLE
    • EBOOK
    • PODCASTS
    • VIDEOS
    • WEBINARS
  • EVENTS
    • EVENT CALENDAR
    • IMTS
  • DIRECTORIES
    • BUYERS GUIDE >
      • Supplier Insights
    • NDT SOURCEBOOK
    • VISION & SENSORS
    • TAKE A TOUR
  • INFOCENTERS
    • Digital Quality Management Systems
    • NEXT GENERATION SPC & QUALITY ANALYTICS
  • AWARDS
    • ROOKIE OF THE YEAR
    • PLANT OF THE YEAR
    • PROFESSIONAL OF THE YEAR
  • MORE
    • Expert Columns
    • NEWSLETTERS
    • QUALITY STORE
    • INDUSTRY LINKS
    • SPONSOR INSIGHTS
  • EMAG
    • eMAGAZINE
    • ARCHIVES
    • CONTACT
    • ADVERTISE
  • SIGN UP!
Software

Software

SPC Without the “S” - Dealing with Automated Data Flows

Process monitoring is easier than ever with the technology available to quality professionals.

By Rob Lievense
Managers having a discussion while automated robot arms work and AI computer vision scans conveyor line.

Image Source: gorodenkoff / iStock / Getty Images

October 18, 2024
✕
Image in modal.

Statistical process control (SPC) charts are valuable tools to ensure the stability processes for many industries. Technology continues to improve, and it is now possible to collect all the data from a process. Automated data is the population flowing over time; therefore, is the “S” still a viable part of SPC? Advances in technology relating to data availability require a review of methods to ensure that monitoring techniques are appropriate.

Manufacturing operations have relied upon SPC to mitigate the risk of unfavorable outcomes that come from an unstable process since Walter Shewhart established the techniques in the 1920s. As the name implies, the heart of the method involves utilizing random samples to calculate the statistics that bound the expectation of the amount of random variation in a population of results. Sampling allows one to make estimates of the population since it was not feasible to collect all the data. One example of an estimate of standard deviation for control charts is the Rbar method using the range of each subgroup (ri) to calculate (sr), which is an unbiased estimator of the standard deviation parameter as shown below:

 where        

The sample size is typically small (3 to 5 parts) and is key to calculating the estimate. The continuous flow of all data challenges estimation techniques as the population of data can now be monitored over time.

Over the last few decades, process technology and data handling has advanced rapidly. It is now possible to collect every measurement of a process and do it at minimal cost. New instruments and machines are designed with sensors and point of process monitors. Having so much data increases the risk of over adjustment. SPC traditionally helped process engineers mitigate over adjustment as the control charts could easily detect process shifts and excess variation resulting from operational technicians “tweaking” the process to their liking. It is ironic that the quest for real time flows of process data can easily result in overadjustment from reactions to slight changes that are within the zone of random process variation. The lessons of Deming ‘s funnel experiment[1] must be part of standard operating procedure to require the study of causes of variation before adjustments are made. Over adjustment creates added variation, which is the antithesis of a stable process.

[i]

 

Manufacturing execution systems (MES) are put in place to collect a large amount of process data over time. Integrated devices no longer require an operator to manually select a sample and measure units manually. The data is readily available; however, is it truly representative of the actual measures? Each data collection apparatus should be thought of as a measurement device. The value of the data cannot be effectively realized until the measurement system is verified for accuracy and precision. Equipment qualification procedures are common for new processes; however, signals can degrade over time due to numerous factors. Efforts should go beyond the technical specification sheets to dedicate resources for regular verification, which is often known as system suitability. System suitability typically involves utilizing a control providing the most accurate reference value possible passed through the system, recording results, and tracking data over time. Continued qualification monitored via a time-based chart is an effective way of ensuring measurement robustness. Forward thinking organizations track system suitability values over time to allow for the detection of instability or drift.

 

 

 

Process monitoring of outputs allows detecting instability in the quickest possible elapsed time. The value of quick detection is not fully realized without data from inputs to a process that may relate to the change in the trend. One inherent issue is to ensure that all measures collected are from the same window of time. This can be a challenge for measures that originate from a different source than the process at hand. Examples include environmental values like ambient temperature and relative humidity. Multiple sources of data may exist for the immediate process data, environmental data, transactional (ERP) data, human resource data, and more. The manufacturing execution system alone may not provide all the data needed to properly determine inputs that leverage changes in outputs; therefore, inclusion of an extract, transform, and load (ETL) solution is an important part of comprehensive process monitoring. The goal is not to only detect changes, it is having the ability to quickly pivot to find remedies to unfavorable process changes using predictive analytics. The integration of an ETL solution with the MES and other systems is a critical way to automate the gathering and preparation of data for proper analyses as quickly as a trend is detected. Engineers can focus efforts much more quickly than ever before possible when the various sources of data are merged to allow for solving problems using insights gleaned quickly with integrated analytics.

As noted previously, statistical process control uses calculated control limits to illustrate the variation derived from multiple samples over time. Established processes tend to utilize the variation within the subgroups to calculate limits. Automated data collection flows with no apparent subgroups, not consisting of a set of random samples; therefore, the concept of calculated control limits does not apply. One technique used to deal with continuous data flows can be a simple run chart with capability-based alert limits. The technique works best for mature processes that tend to run well within specifications. When observations go outside the alert limit, it indicates the process may be departing from acceptable capability. The capability performance must be known prior to establishing alert limits to mitigate the risk of excess alerts.

Engineers start with the goal of the minimally acceptable capability value and build limits to the percentage of the specifications that must be maintained. An example would be a measurement that has a specification range of 120 to 140 units; the perfectly centered process has a mean of approximately 130. Assume a long-term capability goal of Ppk = 1.33, which means that 1 1/3 distributions of data can fit within the specifications. A sample of data that is 72% of specifications relates to the 1.33 Ppk goal.

 

 

To illustrate, a normal sample of 100 units is created with a mean of 130 and standard deviation of 2.4. The standard deviation is derived as 78% of the tolerance range of 20 divided by 6 to estimate the standard deviation. The control limits of the data 123 and 137 now can be effective alert limits for the maintenance of a process capable of 1.33 Ppk.

 

Another way to deal with continuous flows of data can be the use of automated sampling. Automated sampling can be in the form of a simple damper and diversion chute controlled by signals from the equipment PLC to a complex robotic arm that selects units from the flow for measurement. One example is the measurement of multiple elements of pharmaceutical tablets. A tablet press creates many tablets flowing from output chutes. Automated diverters will close to allow a sample of tablets to be measured for weight, thickness, hardness, and sometimes the amount of active ingredient. The measurement device has a moving turret that allows for each of the sample tablets to pass each inspection station with data collected in memory and pushed to a data storage location. Rational subgrouping is inherent in this form of automated data sampling; therefore, typical statistical control charts can be utilized to monitor the process.

[ii]

 

The nature of pulling samples to estimate the behavior of the population is the same whether done manually or via automation. The added value of this technique is that measurement can easily be converted to manual collection in the case of malfunctioning systems. One potential drawback is that automated sampling devices must be engineered into equipment designs as it can be difficult and resource intensive to update existing equipment.

Process monitoring is easier than ever with the technology available to quality professionals. This article is hopefully provoking thoughts about applying the most appropriate techniques to control processes in the era of automated data flows. Such flows of data challenge previous concepts used to estimate a population. Automated data can provide faster focus for engineers to correct unfavorable trends; however, it also creates potential pitfalls. The idea that remains constant is the thoughtful consideration into why changes in trends may be taking place before reacting. Considering why changes have taken place is the most essential element of true process control regardless of how we deal with the “S.”

[1]https://deming.org/explore/the-funnel-experiment/

[i] https://deming.org/

[ii] https://www.kraemer-elektronik.com/

RELATED ARTICLES

  • Using Robotics and Automated Inspection in Manufacturing to Achieve Autonomous Process Control
  • Using Data to Drive Organizational Action
  • Short Run SPC for Small Batch Manufacturing
KEYWORDS: data manufacturing metrology statistical process control (SPC)

Share This Story

Looking for a reprint of this article?
From high-res PDFs to custom plaques, order your copy today!

Rob Lievense, solutions architect, Minitab LLC. For more information, visit www.minitab.com.

Recommended Content

JOIN TODAY
to unlock your recommendations.

Already have an account? Sign In

  • 2024 Quality Rookie of the Year Justin Wise 1440x750px banner with "Quality Rookie of the Year" logo inset

    Meet the 2024 Quality Rookie of the Year: Justin Wise

    Justin Wise is an exceptional individual who has been...
    Aerospace
    By: Michelle Bangert
  • Man with umbrella and coat stands outside while it rains at night looking at a building.

    Nondestructive Testing: Is there an ethics problem?

    I was a whistleblower who exposed fraudulent activities...
    NDT
    By: Dale Norwood
  • Unraveling Deflategate: Football stadium with closeup of football on field

    Unraveling the Tom Brady Deflategate

    The Deflategate scandal erupted following the 2014 AFC...
    Measurement
    By: Greg Cenker and Henry Zumbrun
Manage My Account
  • eMagazine Subscriptions
  • Newsletters
  • Online Registration
  • Subscription Customer Service
  • Manage My Preferences

More Videos

Sponsored Content

Sponsored Content is a special paid section where industry companies provide high quality, objective, non-commercial content around topics of interest to the Quality audience. All Sponsored Content is supplied by the advertising company and any opinions expressed in this article are those of the author and not necessarily reflect the views of Quality or its parent company, BNP Media. Interested in participating in our Sponsored Content section? Contact your local rep!

close
  • Key Takeaways for Quality Leaders
    Sponsored byComplianceQuest

    Key Takeaways for Quality Leaders from the 2026 Gartner Magic Quadrant™ for QMS

  • This image shows a person seated next to a Bobcat T66 compact track loader.
    Sponsored byPolyWorks by InnovMetric

    Supercharging Digital Gauging at Bobcat North America

  • Dorsey Calibration Lab photo by Tom LaBarbera Picture this Studios
    Sponsored byDorsey Metrology International

    Ensuring Product Quality in a Competitive Manufacturing Landscape

Popular Stories

This image shows a person seated next to a Bobcat T66 compact track loader.

Supercharging Digital Gauging at Bobcat North America

a professional in the aviation field performing maintenance, repair, and overhaul (MRO) work

Manufacturing Retention: Strategies for Improving Company Culture, Engagement and Skill Development

Dorsey Calibration Lab photo by Tom LaBarbera Picture this Studios

Ensuring Product Quality in a Competitive Manufacturing Landscape

2026 Quality Professional of the Year!

Events

June 22, 2026

Automate 2026

Automate is North America's largest robotics and automation event — and the best place to take your ideas from insight to impact.
 
Our show floor features the world’s leading automation solutions, from AI and robotics to motion control, vision systems, and more. Plus, our educational conference is second to none, led by the brightest minds in automation today.
 
Ready to transform the way you work? Take the next step at Automate.
July 14, 2026

Quality Leaders Forum: Better Communication, Better Quality Data

The Quality Leaders Forum is a quarterly, editor-moderated fireside chat series hosted by Quality Magazine, featuring candid conversations with senior manufacturing and operations executives shaping enterprise-level quality.

View All Submit An Event

Products

Lean Manufacturing and Service Fundamentals, Applications, and Case Studies

Lean Manufacturing and Service Fundamentals, Applications, and Case Studies

See More Products
Quality Podcast Channel Custom Content

Related Articles

  • Dealing with Unhappy Customers

    See More
  • Jim's Gems: Dealing With Rejection

    See More

Related Products

See More Products
  • Five S Factory Makeover DVD

  • Five S Factory Makeover DVD

  • The Quality Calibration Handbook

See More Products

Related Directories

  • SPC Innovations Inc.

    SPC Innovations specializes in real-time in-process part gaging and detection of broken tools in lathes and machining centers. Actions taken for out of tolerance parts and broken tools include bad part diversion and machine cycle interruption. Measurement data may be output for automatic tool offsets, statistical process control, and reporting.
  • BitFlow Inc.

    Since 1993, BitFlow has been developing industrial frame grabbers and software specializing in interfacing to cameras with high data/frame rates; and running in applications where every CPU cycle is precious. We currently offer CoaXPress, Camera Link, and Differential frame grabbers. Our customers are in every industry where a machine vision system is used. Choose the best, Choose BitFlow!
  • Starrett Co., The L.S.

    Founded in 1880, The L.S. Starrett Company is a leading global manufacturer of precision measuring tools and gages, optical comparators and vision systems, force and material testing and hardness testing solutions. Starrett also manufactures laser measurement systems, custom engineered granite solutions, custom gaging, band saw blades, power tool accessory saw blades, workshop tools and jobsite tools.
×

Stay in the know with Quality’s comprehensive coverage of
the manufacturing and metrology industries.

Newsletters | Website | eMagazine

JOIN TODAY!
  • RESOURCES
    • Advertise
    • Contact Us
    • Directories
    • Manufacturing Division
    • Store
    • Want More
  • SIGN UP TODAY
    • Create Account
    • eMagazine
    • Newsletters
    • Customer Service
    • Manage Preferences
  • SERVICES
    • Marketing Services
    • Market Research
    • Reprints
    • List Rental
    • Survey/Respondent Access
  • STAY CONNECTED
    • LinkedIn
    • Facebook
    • YouTube
    • X (Twitter)
  • PRIVACY
    • PRIVACY POLICY
    • TERMS & CONDITIONS
    • DO NOT SELL MY PERSONAL INFORMATION
    • PRIVACY REQUEST
    • ACCESSIBILITY

Copyright ©2026. All Rights Reserved BNP Media, Inc. and BNP Media II, LLC.

Design, CMS, Hosting & Web Development :: ePublishing