Quality Magazine logo
search
cart
facebook twitter linkedin youtube
  • Sign In
  • Create Account
  • Sign Out
  • My Account
Quality Magazine logo
  • NEWS
  • PRODUCTS
    • FEATURED PRODUCTS
    • SUBMIT YOUR PRODUCT
  • CHANNELS
    • AUTOMATION
    • MANAGEMENT
    • MEASUREMENT
    • NDT
    • QUALITY 101
    • SOFTWARE
    • TEST & INSPECTION
    • VISION & SENSORS
  • MARKETS
    • AEROSPACE
    • AUTOMOTIVE
    • ENERGY
    • GREEN MANUFACTURING
    • MEDICAL
  • MEDIA
    • A WORD ON QUALITY PUZZLE
    • EBOOK
    • PODCASTS
    • VIDEOS
    • WEBINARS
  • EVENTS
    • EVENT CALENDAR
    • IMTS
  • DIRECTORIES
    • BUYERS GUIDE >
      • Supplier Insights
    • NDT SOURCEBOOK
    • VISION & SENSORS
    • TAKE A TOUR
  • INFOCENTERS
    • Digital Quality Management Systems
    • NEXT GENERATION SPC & QUALITY ANALYTICS
  • AWARDS
    • ROOKIE OF THE YEAR
    • PLANT OF THE YEAR
    • PROFESSIONAL OF THE YEAR
  • MORE
    • Expert Columns
    • NEWSLETTERS
    • QUALITY STORE
    • INDUSTRY LINKS
    • SPONSOR INSIGHTS
  • EMAG
    • eMAGAZINE
    • ARCHIVES
    • CONTACT
    • ADVERTISE
  • SIGN UP!

Other Dimensions: Beyond the Math

By Hill Cox
April 4, 2012
Applying gage tolerances can be more complicated than it seems.



One of the big advantages of computers is their ability to process mathematical calculations at lightning speed. Their biggest drawback is the input side of the operation, something that involves humans. They are dealing with numbers but have no idea what the numbers mean in practical terms. And sometimes, their human operators don’t either.

Vigilant readers of this column will have already noted where problems are likely to arise: the human side of the operation. There are tables, charts, software and rules of thumb that can provide numbers for gage tolerances, but in the end they are simply numbers. And just when you think you’ve got things sorted out, along comes dimensional metrology to show that no matter how many decimal places your tolerance calculations are taken to, many of them won’t be of much practical use.

One rule of thumb that is used to arrive at a gage tolerance is the 1/10th rule. Simply put, the product feature tolerance is divided by ten and this is the amount of that tolerance that can be used for the gage. If the part tolerance is 0.001 inch, the gage tolerance would be 0.000l inch.

The simple example I note here starts to unravel when tighter component tolerances are involved and millionths of an inch are required to follow the rule. For some folks, it doesn’t matter if they’re talking about ten thousandths of an inch or millionths, they are simply numbers.

Most gage catalogs include a chart of standardized tolerances, making it easier to specify your needs, but these are essentially a simple mathematical treatment of numbers. For example, Class XX tolerance is half that of Class X. Effectively applying these tolerances can be much more complicated than the neat little charts they are a part of.

In the past, it was assumed that gage makers were the people with the best measurement capabilities. Today, more gage users are equipping their calibration laboratories with instrumentation that is as good as or better than many gage makers. This general improvement is offset somewhat by a decline in the knowledge and skills required to use such equipment effectively.

Numbers on a piece of paper are one thing. Proving them is quite another. And this is where the numbers and reality part company as measurement uncertainty shows that some of them will remain desirable but unreachable for the foreseeable future.

A common error in selecting gage tolerances is to pick one that is better than required on the assumption it will be a better gage. It may be. However, proving it might be impossible. And often it is a complete waste of money.

Typical of this is selecting Class XX plain gages to check parts straight off the machine. Temperature variations alone can make such tolerances effectively useless. Measurement uncertainty could mean that what you thought was a gage of that accuracy is in reality not even close. And this could be due to other factors, not just temperature.

Setting masters such as discs or rings have similar problems but at least there is a way around the problem by using lower accuracy gages calibrated to a higher level. This provides a “known” value compared to one with a tolerance attached to it that must be allowed for.

All of these comments can lead to a situation where the metrology cannot verify the math so the selected gage tolerance is not achievable. Both must be considered to obtain an accurate functional gage. When this is not possible, fixed limit gaging is unlikely to work as expected and some form of measuring device must be used.

Selecting gages to tolerances that are tighter than necessary means less of the part tolerance is used up by the gages, which is a saving. On the other hand, it means purchase costs for gages are higher than they should be and causes premature gage rejection at calibration time so gage costs go up even more.

The doubting Thomases or disbelieving Diannes of this world will be all over these comments because there is so much faith in the printed word-or number. Even worse, now there’s more faith in numbers on a computer screen.

When the metrology can’t back up the math, the numbers involved become meaningless irrespective of what software generates them. The metrology must complement the math.

Share This Story

Looking for a reprint of this article?
From high-res PDFs to custom plaques, order your copy today!

Hill Cox is the chairman for the technical committee for the American Measuring Tool Manufacturers Association and president of Frank Cox Metrology Ltd. He can be reached at [email protected] or at 905-457-9190. 

Recommended Content

JOIN TODAY
to unlock your recommendations.

Already have an account? Sign In

  • 2024 Quality Rookie of the Year Justin Wise 1440x750px banner with "Quality Rookie of the Year" logo inset

    Meet the 2024 Quality Rookie of the Year: Justin Wise

    Justin Wise is an exceptional individual who has been...
    Aerospace
    By: Michelle Bangert
  • Man with umbrella and coat stands outside while it rains at night looking at a building.

    Nondestructive Testing: Is there an ethics problem?

    I was a whistleblower who exposed fraudulent activities...
    NDT
    By: Dale Norwood
  • Unraveling Deflategate: Football stadium with closeup of football on field

    Unraveling the Tom Brady Deflategate

    The Deflategate scandal erupted following the 2014 AFC...
    Measurement
    By: Greg Cenker and Henry Zumbrun
Manage My Account
  • eMagazine Subscriptions
  • Newsletters
  • Online Registration
  • Subscription Customer Service
  • Manage My Preferences

More Videos

Sponsored Content

Sponsored Content is a special paid section where industry companies provide high quality, objective, non-commercial content around topics of interest to the Quality audience. All Sponsored Content is supplied by the advertising company and any opinions expressed in this article are those of the author and not necessarily reflect the views of Quality or its parent company, BNP Media. Interested in participating in our Sponsored Content section? Contact your local rep!

close
  • Key Takeaways for Quality Leaders
    Sponsored byComplianceQuest

    Key Takeaways for Quality Leaders from the 2026 Gartner Magic Quadrant™ for QMS

  • This image shows a person seated next to a Bobcat T66 compact track loader.
    Sponsored byPolyWorks by InnovMetric

    Supercharging Digital Gauging at Bobcat North America

  • Dorsey Calibration Lab photo by Tom LaBarbera Picture this Studios
    Sponsored byDorsey Metrology International

    Ensuring Product Quality in a Competitive Manufacturing Landscape

Popular Stories

a titanium diaphragm speaker driver

The One Thing Elon Gets Right Is Designed to Scare You

This image shows a person seated next to a Bobcat T66 compact track loader.

Supercharging Digital Gauging at Bobcat North America

Dorsey Calibration Lab photo by Tom LaBarbera Picture this Studios

Ensuring Product Quality in a Competitive Manufacturing Landscape

2026 Quality Professional of the Year!

Events

June 9, 2026

Future-Proof your Quality Processes with Advanced 3D Optical CMM Technology

Discover how to effortlessly capture complex data, leverage true multi-sensor automation, and ensure continuous operation without creating inspection delays.

June 22, 2026

Automate 2026

Automate is North America's largest robotics and automation event — and the best place to take your ideas from insight to impact.
 
Our show floor features the world’s leading automation solutions, from AI and robotics to motion control, vision systems, and more. Plus, our educational conference is second to none, led by the brightest minds in automation today.
 
Ready to transform the way you work? Take the next step at Automate.
View All Submit An Event

Products

Lean Manufacturing and Service Fundamentals, Applications, and Case Studies

Lean Manufacturing and Service Fundamentals, Applications, and Case Studies

See More Products
Quality Podcast Channel Custom Content

Related Articles

  • Other Dimensions: The Other Stuff

    See More
  • Other Dimensions: And the Other Answer is...

    See More
  • Other Dimensions: The Right Instrument for the Job

    See More

Related Products

See More Products
  • Juran Institute's Six Sigma Breakthrough and Beyond Quality Performance Breakthrough Methods

See More Products

Events

View AllSubmit An Event
  • July 29, 2025

    Beyond the Checklist: Restoring Integrity in Aerospace Quality Assurance

    On Demand As aerospace systems become increasingly digitized, it’s more important than ever to uphold the proven value of hands-on Quality Assurance (QA) and nondestructive testing (NDT).
View AllSubmit An Event
×

Stay in the know with Quality’s comprehensive coverage of
the manufacturing and metrology industries.

Newsletters | Website | eMagazine

JOIN TODAY!
  • RESOURCES
    • Advertise
    • Contact Us
    • Directories
    • Manufacturing Division
    • Store
    • Want More
  • SIGN UP TODAY
    • Create Account
    • eMagazine
    • Newsletters
    • Customer Service
    • Manage Preferences
  • SERVICES
    • Marketing Services
    • Market Research
    • Reprints
    • List Rental
    • Survey/Respondent Access
  • STAY CONNECTED
    • LinkedIn
    • Facebook
    • YouTube
    • X (Twitter)
  • PRIVACY
    • PRIVACY POLICY
    • TERMS & CONDITIONS
    • DO NOT SELL MY PERSONAL INFORMATION
    • PRIVACY REQUEST
    • ACCESSIBILITY

Copyright ©2026. All Rights Reserved BNP Media, Inc. and BNP Media II, LLC.

Design, CMS, Hosting & Web Development :: ePublishing