This website requires certain cookies to work and uses other cookies to help you have the best experience. By visiting this website, certain cookies have already been set, which you may delete and block. By closing this message or continuing to use our site, you agree to the use of cookies. Visit our updated privacy and cookie policy to learn more.
This Website Uses Cookies
By closing this message or continuing to use our site, you agree to our cookie policy. Learn More
This website requires certain cookies to work and uses other cookies to help you have the best experience. By visiting this website, certain cookies have already been set, which you may delete and block. By closing this message or continuing to use our site, you agree to the use of cookies. Visit our updated privacy and cookie policy to learn more.
Quality Magazine logo
search
cart
facebook twitter linkedin youtube
  • Sign In
  • Create Account
  • Sign Out
  • My Account
Quality Magazine logo
  • Home
  • The Magazine
    • Current Issue
    • Digital Edition
    • Archives
    • How To Guide
    • Industry News
    • Subscribe
  • Web Exclusives
    • Blogs
    • NDT Exclusives
    • Quality Exclusives
    • Vision & Sensors
  • New Products
  • Channels
    • Management
    • Measurement
    • NDT
    • Quality 101
    • Software
    • Test & Inspection
    • Vision & Sensors
  • Markets
    • Aerospace
    • Automotive
    • Electronics
    • Energy
    • Green Manufacturing
    • Medical
    • Plastics
  • More
    • Leadership 100 Survey
    • Plant of the Year
    • Professional of the Year
    • Job Board
    • White Papers
    • Quality Store
    • Software Downloads
    • eCards
    • Product Spotlights
    • Industry Links
    • Sponsor Insights
    • Market Research
  • Multimedia
    • eNewsletter
    • Podcasts
    • Videos
    • Webinars
    • Showcases
    • Image Galleries
    • Interactive Spotlights
  • Events
    • IMTS
    • Event Calendar
    • Quality Show
  • InfoCenters
    • Manage Quality, Risk & Compliance
    • Material Science Quality within Microscopy
    • Modern Quality Control with SPC
    • Process Control in Manufacturing
  • Directories
    • Buyers Guide
    • NDT Sourcebook
    • V&S Sourcebook
    • Take a Tour
  • Contact
    • Contact Us
    • Advertise
Home » Image Analysis for Machine Vision
Vision & Sensors

Image Analysis for Machine Vision

IT IS THE PART OF MACHINE VISION WHERE THE BULK OF THE ACTUAL “WORK” TAKES PLACE.

FT4-101_sl1
This image shows a pattern match tool that has been configured to search for a gear model. We can see that this "edge-based" tool reliably finds both target objects regardless of contrast variations. Source: FANUC
FT4-101_sl2
A typical grayscale image showing variations in pixel color, intensity and contrast. Source: FANUC
FT4-101_sl3
This is a close-up of individual pixels from the grayscale image. Changes that we might see as sharp edges are slow transitions in the digital image. Source: FANUC
FT4-101_sl4
An edge-based representation of the original image [grayscale]. Subtle gradient transitions are represented as a lighter gray value, and strong transitions are darker. Source: FANUC
FT4-101_sl5
The same image after being separated into "binary" content. The first binary image is configured to show objects that are lighter than the local background, and the second is configured to show objects that are darker than the local background. Source: FANUC
FT4-101_sl6
FT4-101_sl7
A tool using blob analysis to identify and locate an object. Note that the tool has been configured for and only locates an object that is light with respect to the background. The other similar object is not identified in this case. Source: FANUC
FT4-101_sl8
This tool uses gradient transitions to accurately locate edges within a targeted region. It is robust even with subtle edges can be seen in the result information. The data representation depicts both the raw grayscale values of the pixels as well as the specific peaks where rising and falling changes are detected. Source: FANUC
FT4-101_sl1
FT4-101_sl2
FT4-101_sl3
FT4-101_sl4
FT4-101_sl5
FT4-101_sl6
FT4-101_sl7
FT4-101_sl8
September 11, 2014
David Dechow
KEYWORDS image analysis / image analysis tools
Reprints
No Comments

What is image analysis? The term is widely used over a variety of technology disciplines, and has varying meanings. To define image analysis within machine vision, take a moment first to consider the broad scope of the typical industrial inspection or guidance application. Digital cameras or other complex sensors are integrated with lenses or specialized optics along with dedicated light sources to capture a picture or representation of an object. By various means, the picture might be manipulated to enhance and optimize the content. Specialized software tools are used to extract information from features in the picture. Ultimately, that information is provided to the automated process for tasks like guidance, measurement, or quality assurance.

These important steps within a successful machine vision application can be grouped into general operational categories. The terms image acquisition, image processing, image analysis, and results processing often are used to describe the four actions mentioned above. (Although the terminology certainly makes sense for machine vision, bear in mind that these designations are only loosely used, and can take on different meanings depending on context.) In this tutorial we will focus on image analysis, and will cover just a few of the very basic concepts of this broad and important part of machine vision technology and software.

For our purposes then, image analysis is the part of machine vision where the bulk of the actual “work” takes place. In short, image analysis is where data and information required by the application and the automation system are extracted from an image. Getting the right information, repeatably and reliably, requires competent specification and application of one or perhaps many inspection algorithms. To help with that, one should first understand a couple of the ways content is extracted from an image.

Extracting image content

Fundamentally, an image used for general purpose machine vision contains thousands of data points that we more commonly call “pixels.” For most image acquisitions, these data points contain a value representing the amount of light that has been captured by the pixel (called the “grayscale” value of the pixel). A pixel also has a location relative to its position on the sensor. In some cases, like when the image represents a 3-D cloud of points, the pixel location might be represented as a point in real world space with X, Y, Z coordinates. For this introductory discussion though, we will only cover analysis for 2-D, grayscale information.

In the analysis of an image, machine vision software performs operations on the pixel data using both location and the grayscale value of a pixel or, most often, groups of neighboring pixels. To help differentiate the basic function of these operations, we can classify many as using either native grayscale information, or using gradient information that is derived directly from the grayscale information. In machine vision image analysis, gradient in its most simple context means the changes in grayscale observed between neighboring pixels. Another term often used for image gradients is edges. In fact, it is not uncommon to have the root process of a machine vision tool (or “algorithm”) described as “grayscale-based” or “edge-based.” Let’s briefly look into how this works and how it might impact our selection and application of a tool for image analysis.

Pixels and edges

The grayscale value of a pixel represents the amount of light stored by that pixel when the image is captured. Many external factors affect this value including light intensity and color, object reflectivity, optics, camera exposure time, and others. On a plant floor, influencers like ambient light, part presentation, and part variation can also impact the grayscale image content. These changes in the image content might result in incorrect analysis. Proper application of lighting, optics, cameras and components for image acquisition can help to ensure consistent response, and pre-processing also is useful in ensuring image grayscale repeatability when using any machine vision tool, and particularly grayscale-based tools.

Image analysis tools can use native grayscale data count and/or group pixels within constrained ranges of grayscale values; or specific “colors.” Such tools can, for example, extract features within an image and provide information about the location, size and shape of the feature, or report the general color of image within specific regions.

Edge-based tools perform processing on localized changes in the color of neighboring pixels. These gradients are mathematically calculated in a variety of ways depending upon the algorithm. Whether the change in color is subtle or intense, the gradient usually can be calculated. The importance of this capability is that as a scene changes in brightness and/or contrast, a process can still extract edge data as long as there is a sufficient gradient, or change of color, across the targeted neighboring pixels.

Image analysis tools that use edges to get information from an image can make use of the intensity of the edge as well as the position and perhaps the direction of edge points and groups of edges points. Typical image analysis operations using edges include measurements between edges of a target feature or the location of edges or groups of edges to determine feature position and geometry.

Understanding these basics of image content as used by many machine vision tools for image analysis aids us in the selection and implementation of those tools for a specific application. For example, images with features or defects that are well defined with consistent color might respond well to tools that process grayscale information while edge-based tools might be used to overcome image variations. Let’s consider some typical machine vision tools, and their uses in practical applications.

Typical image analysis tools and practical applications

General purpose components for machine vision, such as smart cameras and PC-based systems, offer a broad range of tools for image analysis. Sometimes these involve complex combinations of algorithms that effectively extract information for a specific type of process. In many cases, though, the job only requires the prudent application of just a few simpler tools. Here we’ll briefly introduce four of those tools and their implementation in image analysis.

One very basic tool provides the capability to analyze grayscale pixel content in the image or region of an image statistically. These “histogram analysis” tools simply count the number of pixels found at each gray level. The counts themselves can be useful in determining the content of an image. Knowing, for example, the average color of a feature, and the typical number of pixels covering the feature, a test of the number of pixels in the appropriate color range can verify the presence/absence and perhaps even the size of the target feature. The algorithm often provides other extensive statistical information about the grayscale data as well. The process time for this type of tool is very quick, and these tools are frequently used for things like part presence and defect detection.

Another powerful grayscale image analysis tool is “connectivity” also known as “blob analysis” or in some implementations “particle analysis.” Again working with pixel colors, the connectivity tool groups neighboring pixels of similar colors into connected forms. It does so usually by first separating the colors of the pixels into two states—light or dark—based upon a dividing “threshold” (the resulting pixel representation is called a “binary” image). The tool provides information about the connected blobs, including size, shape, location, and much more. As with the histogram tool, blob analysis is a very fast process. It is used for part presence/absence and differentiation, location and guidance, defect detection and more.

A basic edge-based process is that of the measurement of a pair of edges or the location of a single edge in an area of the image. Tools that perform this function might be called “calipers” or “edge pairs.” The feature of this type of algorithm is that it returns a very accurate and repeatable point (or line or possibly circle) at the edge of a feature in the image over a very broad range of image brightness and contrast variation. This type of tool is used for measurement, or can be instrumental in part differentiation or presence/absence.

A vastly more complex tool using (fundamentally) edge information is the “geometric search” or “pattern match.” This type of tool uses a pre-trained model where edges (and other content) are mathematically extracted to form a data representation of the target object. Since the model is strictly data, it can be mathematically re-sized, rotated, skewed, or manipulated as needed for the application, or even created from scratch without an image. A search algorithm then uses the trained model to find matching instances of the model in the image being processed. As with most edge-based tools, a geometric search works well over varying image conditions, and in many cases can even find a model in significantly degraded images. A geometric search is critical to many applications involving precision location and guidance, and can be used also for a variety of other processing like part presence/absence and feature/object differentiation.

What’s Next

 This tutorial has only introduced some of the basic topics in the broad range of machine vision image analysis. As a starting point, it is important to understand these fundamentals as you consider how to best implement a machine vision application, and even more important to take the next steps to learn more about how the technology can benefit many automation applications. 

subscribe to Quality Magazine

Recent Articles by David Dechow

Machine Vision Trends

Machine Vision Systems Integration

Practical VGR: Cutting-Edge Technologies and Applications

A deeper look into using machine vision software and tools for applications in vision guided robotics.

Practical VGR

David L. Dechow is the principal vision systems architect at Integro Technologies. For more information, email ddechow@integro-tech.com or visit http://www.integro-tech.com.

Related Articles

Machine Vision Color Analysis

A deeper look into using machine vision software and tools for applications in vision guided robotics.

USB3 Vision: SuperSpeed for Machine Vision

Vision & Sensors: Reintroducing Machine Vision

Related Products

Machine Vision and Error Proofing DVD

Failure Mode Effects Analysis (FMEA) DVD

Related Events

Machine Vision Applications That Are Pushing the Boundaries in Industrial Automation

Related Directories

Phoenix Imaging Machine Vision

Phoenix Imaging Machine Vision

You must login or register in order to post a comment.

Report Abusive Comment

Subscribe For Free!
  • Print & Digital Edition Subscriptions
  • eNewsletters
  • Online Registration
  • Subscription Customer Service
  • Mobile Help

More Videos

Popular Stories

Speaking of Quality

No More Hamburger Helper

Guest Column

Why is it (quality) so hard?

Lean manufacturing

Lean In to 5S

Quality cost chart

Prevention is the Key to Reduced Quality Costs

The Cost of Quality

Understanding How Management Involvement Impacts the Risk of Quality Cost

BuyersGuide


Poll

Topics to Talk About

What topics would you like to see Quality cover more?
View Results Poll Archive

Products

Quality Brain Teasers: Real World Challenges to Build Your Manufacturing Skills (ebook)

Quality Brain Teasers: Real World Challenges to Build Your Manufacturing Skills (ebook)

Assessments and Training in the following areas...

See More Products

SoftwareDownloads

Quality Magazine

Quality December 2019

2019 December

Check out the December 2019 edition of Quality: Quality 4.0 for medical device manufacturing, automated metrology, gage trends, plastics, materials analysis and much more!
View More Create Account
  • Resources
    • Market Research
    • Custom Content & Marketing Services
    • List Rental
    • Partners
    • Manufacturing Group
    • Polls
    • Privacy Policy
    • Survey and Sample
  • Want More
    • Connect

Copyright ©2019. All Rights Reserved BNP Media.

Design, CMS, Hosting & Web Development :: ePublishing