Quality Magazine logo
search
cart
facebook twitter linkedin youtube
  • Sign In
  • Create Account
  • Sign Out
  • My Account
Quality Magazine logo
  • NEWS
  • PRODUCTS
    • FEATURED PRODUCTS
    • SUBMIT YOUR PRODUCT
  • CHANNELS
    • AUTOMATION
    • MANAGEMENT
    • MEASUREMENT
    • NDT
    • QUALITY 101
    • SOFTWARE
    • TEST & INSPECTION
    • VISION & SENSORS
  • MARKETS
    • AEROSPACE
    • AUTOMOTIVE
    • ENERGY
    • GREEN MANUFACTURING
    • MEDICAL
  • MEDIA
    • A WORD ON QUALITY PUZZLE
    • EBOOK
    • PODCASTS
    • VIDEOS
    • WEBINARS
  • EVENTS
    • EVENT CALENDAR
    • IMTS
  • DIRECTORIES
    • BUYERS GUIDE >
      • Supplier Insights
    • NDT SOURCEBOOK
    • VISION & SENSORS
    • TAKE A TOUR
  • INFOCENTERS
    • Digital Quality Management Systems
    • NEXT GENERATION SPC & QUALITY ANALYTICS
  • AWARDS
    • ROOKIE OF THE YEAR
    • PLANT OF THE YEAR
    • PROFESSIONAL OF THE YEAR
  • MORE
    • Expert Columns
    • NEWSLETTERS
    • QUALITY STORE
    • INDUSTRY LINKS
    • SPONSOR INSIGHTS
  • EMAG
    • eMAGAZINE
    • ARCHIVES
    • CONTACT
    • ADVERTISE
  • SIGN UP!
MeasurementManagement

The Price of Precision

Higher tolerance “insurance” comes with a price tag.

January 8, 2014

There’s an old rule of thumb among suppliers of precision gages that tighter tolerances mean higher prices. This is understandable considering the extra effort involved working within such boundaries. But not all gage users understand this. They want lower prices (always) but when the gage maker suggests that a more appropriate tolerance could result in cost savings, buyers tend to shy away. Having sold, manufactured and calibrated gages for over fifty years, these situations keep arising. I hope a look at the bigger picture may be useful.

The situation comes up quite often when the customer’s product indicates a gage tolerance of 0.000l inch, for example, but a tolerance of 0.00005 inch or less is specified. The tighter tolerance is called up as insurance because the person specifying the gage is not conversant with the process. And they usually don’t consider the implications of doing so further down the line.

There is a point where the tighter tolerance is of no benefit due to the temperature at the point of use. Or, the product being checked with it has surface finish or geometry variations that greatly exceed the tolerance such that the finer tolerance offers no inspection advantage.

Going back to the first paragraph of this rant, the biggest problem with this method of specifying gages is the higher cost of the higher tolerance. Every gage maker charges more for higher tolerances and rightly so since it does take more work to produce them and the risk of scrapping a gage in the process is much higher as well. But there are more costs involved.

Sooner or later, the gage will have to be calibrated after it has been in service for a while. The higher tolerance means there’s less material in the gage to wear out before it is no longer acceptable.

It will have to be calibrated more often than if it had been made to a more practical tolerance. Naturally, this means more expense during its useful life. But there’s another problem.

The higher tolerance gage will wear out of its specified tolerance and be rejected sooner than one made to the proper tolerance. This increases the cost of gaging that part feature.           

Higher tolerance “insurance” comes with a price tag.

Another situation along similar lines comes up frequently where setting masters are concerned. Once more, excessively close tolerances are often called for when they are not needed. The same cost problems occur like those noted earlier. But there’s another problem in this case: the tolerances become so tight that rejection of the master when new can occur due to measurement uncertainty. Or the master could be accepted as new but rejected on calibration due to uncertainty when it has worn very little—if at all.

The purpose of a setting master is to give the device it will be used with a known starting point for measurements. In the case of high/low limit masters, they provide assurance the unit is performing reasonably accurately within a specified range.

In either case, it is not necessary for the masters to be made to super-accurate tolerances. The ideal is to know what their dimensions are to a high level of precision. Minor variations from the desired size or sizes are acceptable when you know what they are. Calibration provides the exact values they represent. 

An example of this would be where a master is made to 50 micro-inches and the measuring instrument is set to the nominal value or zero. This means the setting could be off by 50 micro-inches. However, if the master was made to 100 micro-inches or 0.0001 inch but its calibrated value used, the most it would be off could be the uncertainty of the calibration or less than half that of the more accurately made master. All you have to do is put the actual value or variation from nominal into your setting as an offset.

Using this method, the original cost of the master(s) is lower, and since the tolerance is much larger, the master will be considered acceptable for a much longer time before replacement is needed. Higher accuracy at lower cost.

As you can see from these examples, a little bit of care in selecting gage or master tolerances can provide extra gage life, better accuracy and lower costs. 

 

 Hill Cox is president of Frank J. Cox Sales Ltd. (Brampton, Ontario, Canada). He may be reached at [email protected]

KEYWORDS: calibration gages

Share This Story

Looking for a reprint of this article?
From high-res PDFs to custom plaques, order your copy today!

Recommended Content

JOIN TODAY
to unlock your recommendations.

Already have an account? Sign In

  • 2024 Quality Rookie of the Year Justin Wise 1440x750px banner with "Quality Rookie of the Year" logo inset

    Meet the 2024 Quality Rookie of the Year: Justin Wise

    Justin Wise is an exceptional individual who has been...
    Aerospace
    By: Michelle Bangert
  • Man with umbrella and coat stands outside while it rains at night looking at a building.

    Nondestructive Testing: Is there an ethics problem?

    I was a whistleblower who exposed fraudulent activities...
    NDT
    By: Dale Norwood
  • Unraveling Deflategate: Football stadium with closeup of football on field

    Unraveling the Tom Brady Deflategate

    The Deflategate scandal erupted following the 2014 AFC...
    Measurement
    By: Greg Cenker and Henry Zumbrun
Manage My Account
  • eMagazine Subscriptions
  • Newsletters
  • Online Registration
  • Subscription Customer Service
  • Manage My Preferences

More Videos

Sponsored Content

Sponsored Content is a special paid section where industry companies provide high quality, objective, non-commercial content around topics of interest to the Quality audience. All Sponsored Content is supplied by the advertising company and any opinions expressed in this article are those of the author and not necessarily reflect the views of Quality or its parent company, BNP Media. Interested in participating in our Sponsored Content section? Contact your local rep!

close
  • Key Takeaways for Quality Leaders
    Sponsored byComplianceQuest

    Key Takeaways for Quality Leaders from the 2026 Gartner Magic Quadrant™ for QMS

  • This image shows a person seated next to a Bobcat T66 compact track loader.
    Sponsored byPolyWorks by InnovMetric

    Supercharging Digital Gauging at Bobcat North America

  • Dorsey Calibration Lab photo by Tom LaBarbera Picture this Studios
    Sponsored byDorsey Metrology International

    Ensuring Product Quality in a Competitive Manufacturing Landscape

Popular Stories

a titanium diaphragm speaker driver

The One Thing Elon Gets Right Is Designed to Scare You

This image shows a person seated next to a Bobcat T66 compact track loader.

Supercharging Digital Gauging at Bobcat North America

Dorsey Calibration Lab photo by Tom LaBarbera Picture this Studios

Ensuring Product Quality in a Competitive Manufacturing Landscape

2026 Quality Professional of the Year!

Events

June 9, 2026

Future-Proof your Quality Processes with Advanced 3D Optical CMM Technology

Discover how to effortlessly capture complex data, leverage true multi-sensor automation, and ensure continuous operation without creating inspection delays.

June 22, 2026

Automate 2026

Automate is North America's largest robotics and automation event — and the best place to take your ideas from insight to impact.
 
Our show floor features the world’s leading automation solutions, from AI and robotics to motion control, vision systems, and more. Plus, our educational conference is second to none, led by the brightest minds in automation today.
 
Ready to transform the way you work? Take the next step at Automate.
View All Submit An Event

Products

Lean Manufacturing and Service Fundamentals, Applications, and Case Studies

Lean Manufacturing and Service Fundamentals, Applications, and Case Studies

See More Products
Quality Podcast Channel Custom Content

Related Articles

  • Management feature image of Quality inspector and manual worker in a factory.

    The Price of Excellence: Understanding the Value of Quality, Part 1

    See More
  • Senior official woman and male architectural engineer talking, wearing suits and safety hats.

    The Price of Excellence: Understanding the Value of Quality, Part 2

    See More
  • Jim's Gems: The Price of Success

    See More

Related Products

See More Products
  • ZEuCDwAAQBAJ.jpg

    Lean Six Sigma In The Age Of Artificial Intelligence: Harnessing The Power Of The Fourth Industrial Revolution

  • Building Lean Supply Chains with the Theory of Constraints

  • certified.jpg

    The Certified Manager of Quality / Organizational Excellence Handbook, 4th Edition

See More Products

Related Directories

  • Gradient Lens Corporation

    Gradient Lens Corporation designs, manufactures and sells its patented line of Hawkeye Precision Borescopes. Hawkeyes deliver all the image quality of the finest instruments in the world and sell for less than half the price.
×

Stay in the know with Quality’s comprehensive coverage of
the manufacturing and metrology industries.

Newsletters | Website | eMagazine

JOIN TODAY!
  • RESOURCES
    • Advertise
    • Contact Us
    • Directories
    • Manufacturing Division
    • Store
    • Want More
  • SIGN UP TODAY
    • Create Account
    • eMagazine
    • Newsletters
    • Customer Service
    • Manage Preferences
  • SERVICES
    • Marketing Services
    • Market Research
    • Reprints
    • List Rental
    • Survey/Respondent Access
  • STAY CONNECTED
    • LinkedIn
    • Facebook
    • YouTube
    • X (Twitter)
  • PRIVACY
    • PRIVACY POLICY
    • TERMS & CONDITIONS
    • DO NOT SELL MY PERSONAL INFORMATION
    • PRIVACY REQUEST
    • ACCESSIBILITY

Copyright ©2026. All Rights Reserved BNP Media, Inc. and BNP Media II, LLC.

Design, CMS, Hosting & Web Development :: ePublishing