Quality Magazine logo
search
cart
facebook twitter linkedin youtube
  • Sign In
  • Create Account
  • Sign Out
  • My Account
Quality Magazine logo
  • NEWS
  • PRODUCTS
    • FEATURED PRODUCTS
    • SUBMIT YOUR PRODUCT
  • CHANNELS
    • AUTOMATION
    • MANAGEMENT
    • MEASUREMENT
    • NDT
    • QUALITY 101
    • SOFTWARE
    • TEST & INSPECTION
    • VISION & SENSORS
  • MARKETS
    • AEROSPACE
    • AUTOMOTIVE
    • ENERGY
    • GREEN MANUFACTURING
    • MEDICAL
  • MEDIA
    • A WORD ON QUALITY PUZZLE
    • EBOOK
    • PODCASTS
    • VIDEOS
    • WEBINARS
  • EVENTS
    • EVENT CALENDAR
    • IMTS
  • DIRECTORIES
    • BUYERS GUIDE >
      • Supplier Insights
    • NDT SOURCEBOOK
    • VISION & SENSORS
    • TAKE A TOUR
  • INFOCENTERS
    • Digital Quality Management Systems
    • NEXT GENERATION SPC & QUALITY ANALYTICS
  • AWARDS
    • ROOKIE OF THE YEAR
    • PLANT OF THE YEAR
    • PROFESSIONAL OF THE YEAR
  • MORE
    • Expert Columns
    • NEWSLETTERS
    • QUALITY STORE
    • INDUSTRY LINKS
    • SPONSOR INSIGHTS
  • EMAG
    • eMAGAZINE
    • ARCHIVES
    • CONTACT
    • ADVERTISE
  • SIGN UP!
Vision & Sensors

Vision & Sensors | Measurement

Tips on Making Precision Measurements with Machine Vision – Part 1

The techniques allowing high-precision measurements are well understood and based on solid principles. Calibration is critical to accurate measurements.

By Perry C. West
High-quality control in manufacturing optical sorting machine for fasteners screw in product line.
Getty Images

Image Source: MJ_Prototype / iStock / Getty Images Plus

October 15, 2024
✕
Image in modal.

One capability of machine vision that goes beyond human vision is its ability to make measurements with high precision and accuracy. This first of three parts discusses techniques allowing vision systems to achieve high-precision measurements. The following two parts discuss challenges to achieving high precision and accuracy and how to deal with them.

We should start by agreeing on terms relating to measurement accuracy. The ISO 5725 specification defines accuracy using terms this article will use. (See Figure 1.)

Figure 1-- ISO 5725 Specifies Accuracy
Figure 1-- ISO 5725 Specifies Accuracy

The standard defines trueness as the fixed error between the average of a series of measurements and the accepted true dimensional value. Trueness is a systemic error better calibration could improve, at least in principle.

MACHINE VISION: Tips on Making Precision Measurements with Machine Vision – Part 1

Tips on Making Precision Measurements with Machine Vision

Part 2 | Part 3

Precision is the random variation around trueness exhibited by individual measurements. It is considered caused by unpredictable noise. Most often precision is assumed to be Gaussian and expressed by its standard deviation.

Accuracy is the combination of trueness and some number of standard deviations, typically three, of the precision.

This definition addresses the end user’s question of how accurate the measurement is. That is, what is the maximum expected error between any measured dimension and the dimension’s true value?

High Precision Measurement Techniques

The techniques used in machine vision to achieve high-precision measurements rely on a principle in statistics that states if there is a series of N values (XI..N) representing repeated measurements, and where each value in the series has an uncertainty or variation with a standard deviation σ, then the average of the N values (X̿) will have an uncertainty uncertainty(¯σ):

¯σ= σ/√N

Therefore, image processing in machine vision improves the precision and not the trueness. Since calibration is performed using sub-pixel techniques, it is also common for trueness to be a small fraction of a pixel. Remember, machine vision image processing only provides sub-pixel precision. It does not automatically provide trueness or accuracy to a sub-pixel level.

Figure 2 -- Fitting Points to a Line
Figure 2 -- Fitting Points to a Line
Figure 3 -- A Rake Tool for Measuring Edge Position
Figure 3 -- A Rake Tool for Measuring Edge Position

Multiple Points Along an Edge

One way to achieve sub-pixel precision is to average independent measurement points. An example of this is to fit points along an edge as shown in Figure 2. As the number of data points along the edge increases, the error in the equation fit to the data will have its uncertainty reduced over any one of the measurement points. In this case, the software fits the data points to a model of the edge, typically using a least-squares fit, also known as a regression. The least-squares fit has the effect of averaging.

In many machine vision software systems, this type of measurement is accomplished with a tool often called a rake as shown in Figure 3. The rake has a span along the edge and several tines specifying where to take the individual measurements. The improvement, though, is realized at the center of the measurement range and degrades when moving out from the center toward either end of the measurement range.

The rake can have parallel tines to fit to a straight edge, or radial tines to fit to an arc or a circle. It is possible in principle to fit data points to any shape represented mathematically to reduce the measurement uncertainty.

Figure 4 -- Gray-Scale Edge Interpolation
Figure 4 -- Gray-Scale Edge Interpolation

Gray-Scale Edge Profile

Another technique to improve measurement precision is to fit the edge point to the gray-scale values crossing the edge – the edge profile (see Figure 4). The true edge position is taken to be the inflection of the gray-scale values along the edge. The inflection corresponds to a peak in the first derivative or the zero crossing in the second derivative of the gray-scale values. While it is computationally easier to find a zero crossing than a peak, the second derivative is likely noisier than the first derivative leading to decreased precision.

There is a general notion the image should not reach saturation or be clipped at the bottom end by the camera’s black level setting. This may be true if the edge profile inflection is near the top or the bottom of the gray-scale range. In general, though, if the clipping doesn’t distort the waveform in the vicinity of the inflection, saturation or black-level clipping will not affect the measurement precision.

 Calibration Accuracy -> Part of Trueness in Measurement

Figure 5 -- Calibration Target; Checkerboard Pattern
Figure 5 -- Calibration Target; Checkerboard Pattern
Figure 6 -- Calibration Target; Array of Dots
Figure 6 -- Calibration Target; Array of Dots

You should realize calibration itself is subject to errors from trueness and precision.

Typical calibration is performed with a grid of dots or squares as shown in Figure 6 and Figure 5. The centers of dots or the corners of squares, determined using sub-pixel techniques, are fit to equations to correct for distortion and scaling. Because calibration involves the use of such a great number of data points, its precision should be very good. Most calibration targets are made to very stringent quality and dimensional standards. However, the accuracy and long-term stability of the target must be a major factor in its selection.

Figure 7 -- Three Types of Distortion
Figure 7 -- Three Types of Distortion

The equation for correcting for radial lens distortion is typically a polynomial. See Figure 7 for different types of lens distortions. Software packages use polynomials of different degrees – usually somewhere in the range of 3 to 7 – to correct for lens distortion. A third-degree polynomial can correct well for pincushion or barrel distortion. Some “low distortion” lenses, such as telecentric lenses, exhibit a distortion called wave or mustache distortion. This requires a fifth or seventh-order polynomial to correct.

You need to make sure your software’s calibration approach is appropriate for the lens you are planning to use.

Any errors in calibration contribute to trueness in the measurement. Calibration errors come from the deviation of the calibration target from perfect dimensions, the sub-pixel precision achievable in resolving calibration target features, and the ability of the generated equation to correct for distortion.

Conclusion

The techniques allowing high-precision measurements are well understood and based on solid principles. Calibration is critical to accurate measurements.

The next part of this series will deal with challenges that can detract from accurate measurements and how these challenges can be overcome.

RELATED ARTICLES

  • What Drives the Trends in Machine Vision
  • Image Processing for Machine Vision – How Did We Get Here?
  • Vision & Sensors 101: Machine Vision System Integration
KEYWORDS: calibration machine vision manufacturing metrology

Share This Story

Looking for a reprint of this article?
From high-res PDFs to custom plaques, order your copy today!

Perry C. West is president of Automated Vision Systems Inc. (San Jose, CA). For more information, call (408) 267-1746, e-mail [email protected] or visit www.autovis.com.



Recommended Content

JOIN TODAY
to unlock your recommendations.

Already have an account? Sign In

  • 2024 Quality Rookie of the Year Justin Wise 1440x750px banner with "Quality Rookie of the Year" logo inset

    Meet the 2024 Quality Rookie of the Year: Justin Wise

    Justin Wise is an exceptional individual who has been...
    Aerospace
    By: Michelle Bangert
  • Man with umbrella and coat stands outside while it rains at night looking at a building.

    Nondestructive Testing: Is there an ethics problem?

    I was a whistleblower who exposed fraudulent activities...
    NDT
    By: Dale Norwood
  • Unraveling Deflategate: Football stadium with closeup of football on field

    Unraveling the Tom Brady Deflategate

    The Deflategate scandal erupted following the 2014 AFC...
    Measurement
    By: Greg Cenker and Henry Zumbrun
Manage My Account
  • eMagazine Subscriptions
  • Newsletters
  • Online Registration
  • Subscription Customer Service
  • Manage My Preferences

More Videos

Sponsored Content

Sponsored Content is a special paid section where industry companies provide high quality, objective, non-commercial content around topics of interest to the Quality audience. All Sponsored Content is supplied by the advertising company and any opinions expressed in this article are those of the author and not necessarily reflect the views of Quality or its parent company, BNP Media. Interested in participating in our Sponsored Content section? Contact your local rep!

close
  • Key Takeaways for Quality Leaders
    Sponsored byComplianceQuest

    Key Takeaways for Quality Leaders from the 2026 Gartner Magic Quadrant™ for QMS

  • This image shows a person seated next to a Bobcat T66 compact track loader.
    Sponsored byPolyWorks by InnovMetric

    Supercharging Digital Gauging at Bobcat North America

  • Dorsey Calibration Lab photo by Tom LaBarbera Picture this Studios
    Sponsored byDorsey Metrology International

    Ensuring Product Quality in a Competitive Manufacturing Landscape

Popular Stories

This image shows a person seated next to a Bobcat T66 compact track loader.

Supercharging Digital Gauging at Bobcat North America

a professional in the aviation field performing maintenance, repair, and overhaul (MRO) work

Manufacturing Retention: Strategies for Improving Company Culture, Engagement and Skill Development

Dorsey Calibration Lab photo by Tom LaBarbera Picture this Studios

Ensuring Product Quality in a Competitive Manufacturing Landscape

2026 Quality Professional of the Year!

Events

June 22, 2026

Automate 2026

Automate is North America's largest robotics and automation event — and the best place to take your ideas from insight to impact.
 
Our show floor features the world’s leading automation solutions, from AI and robotics to motion control, vision systems, and more. Plus, our educational conference is second to none, led by the brightest minds in automation today.
 
Ready to transform the way you work? Take the next step at Automate.
July 14, 2026

Quality Leaders Forum: Better Communication, Better Quality Data

The Quality Leaders Forum is a quarterly, editor-moderated fireside chat series hosted by Quality Magazine, featuring candid conversations with senior manufacturing and operations executives shaping enterprise-level quality.

View All Submit An Event

Products

Lean Manufacturing and Service Fundamentals, Applications, and Case Studies

Lean Manufacturing and Service Fundamentals, Applications, and Case Studies

See More Products
Quality Podcast Channel Custom Content

Related Articles

  • Smart robot in manufacturing industry for industry 4.0 and technology concept.

    Tips on Making Precision Measurements with Machine Vision – Part 2

    See More
  • Master sample inspected by optical CMM ; selective focus

    Tips on Making Precision Measurements with Machine Vision – Part 3

    See More
  • Scene Analysis Form

    Lighting Design for Machine Vision, Part 1

    See More

Related Products

See More Products
  • Machine Vision and Error Proofing DVD

  • leaner.jpg

    Leaner Six Sigma: Making Lean Six Sigma Easier and Adaptable to Current Workplaces

See More Products

Events

View AllSubmit An Event
  • November 18, 2025

    Practical Machine Vision – Successful 3D Robotic Bin Picking

    On Demand In this webinar we will describe 3D bin picking and discuss its recent evolution towards a mature technology.
View AllSubmit An Event

Related Directories

  • Machine Vision Store

    Machine Vision Store has a laser-sharp focus on machine vision imaging. We deliver a select group of components - cameras, lenses, lights, industrial vision PC's - from leading manufacturers known for quality. Components we understand, support and stand behind. Components and consulting services that will power your success.
×

Stay in the know with Quality’s comprehensive coverage of
the manufacturing and metrology industries.

Newsletters | Website | eMagazine

JOIN TODAY!
  • RESOURCES
    • Advertise
    • Contact Us
    • Directories
    • Manufacturing Division
    • Store
    • Want More
  • SIGN UP TODAY
    • Create Account
    • eMagazine
    • Newsletters
    • Customer Service
    • Manage Preferences
  • SERVICES
    • Marketing Services
    • Market Research
    • Reprints
    • List Rental
    • Survey/Respondent Access
  • STAY CONNECTED
    • LinkedIn
    • Facebook
    • YouTube
    • X (Twitter)
  • PRIVACY
    • PRIVACY POLICY
    • TERMS & CONDITIONS
    • DO NOT SELL MY PERSONAL INFORMATION
    • PRIVACY REQUEST
    • ACCESSIBILITY

Copyright ©2026. All Rights Reserved BNP Media, Inc. and BNP Media II, LLC.

Design, CMS, Hosting & Web Development :: ePublishing