Abbé Principle: When measuring the displacement of a specified point, it is not sufficient to have the axis of the probe parallel to the direction of motion, the axis should also be aligned with (pass through) the point. Source: Mahr Federal Inc.


Recently, I was approached by a company interested in buying a sophisticated metrology system. They were comparing several different brands, and to be as thorough as possible, had set up a criteria matrix in which one of the questions was, “Is your machine error compensated, yes or no?”

“Well,” I said, “yes, it is” and promptly started to explain the error compensation strategy. That garnered a blank look. “But don’t you want to know what and how?” I asked. “No, thank you,” was the answer.

In fact, error compensation is an important consideration. No matter whether you are interested in a machine tool, a metrology system or another precision device that relies on mechanical motion, what errors of mechanical motion are compensated for and how they are compensated directly impacts that system’s ability to operate at the highest level of capability. It is really not a “yes” or “no” question.

Abbé’s Offset is defined as the distance between the point of contact of a probe on the piece being measured and the axis of the position measuring system. Source: Mahr Federal Inc.

Sources of Mechanical Error

In the world of metrology systems, error compensation is generally considered to be the capability to apply corrections for undesirable or unplanned errors in positioning or motion. Typically, it is used for two reasons: 1) to increase the capability of the machine; or 2) to decrease the cost of manufacture for a given system.

As metrologists we all want to build better machines, but the business side of us tells us that if a system can be built less expensively and yet reach the same level of capability through error compensation, it may be more competitive or more interesting for additional applications where previously the cost was prohibitive.

Excluding temperature, which requires separate compensation techniques, there are five different types of mechanical error.

  • Errors in straightness of guideways. In an ideal case, a straight guideway would provide a perfectly straight path for machine motion. In reality, however, any guideway always will have some error-some curves, dips or bumps. Errors always exist, the only question is, how large or how small these errors are.

  • Errors in drive system or position measuring system. If an object is to move along a guideway, there must be something that drives that motion, such as a lead screw. In theory, the number of revolutions of that screw can be used to calculate how far the object has moved. In reality, screw threads are never perfect and any one revolution will always generate a slight bit more or less motion than the next. To correct for this, manufacturers use devices such as encoders, scales or laser interferometers to measure where the machine is. But while these systems give more accurate position data than counting the revolutions of the screws, they also have some degree of inherent error that must be taken into account.


  • Source: Mahr Federal Inc.

  • Angular misalignment between guideways and position measuring systems. This is commonly referred to as the Abbé Offset or the Abbé Principle, credited to Ernst Karl Abbé, a German physics professor best known for his work in optics. Hired by Carl Zeiss to improve the manufacturing process of optical instruments, Abbé created the mathematical foundation of modern microscope design. He also was much taken with the concept of angular error, and his principle states that “when measuring the displacement of a specified point, it is not sufficient to have the axis of the probe parallel to the direction of motion, the axis should also be aligned with (pass through) the point.”

    Abbé’s Offset is defined as the distance between the point of contact of a probe on the piece being measured and the axis of the position measuring system. In terms of simple measuring instruments, a micrometer is an Abbé-compliant device because the measuring system is perfectly in line with the probe, whereas a caliper, with its measuring point offset from the scale, is not.

  • Deformation of machine under load. In the real world, machines bend under load. Even if a perfect machine could be built-a coordinate measuring machine, for example-with perfectly straight guideways, perfectly perpendicular uprights and perfectly accurate scales, it would still distort when an engine block was plopped on it. And typically when machines distort under load, any error compensation systems designed to correct for positional error are likewise distorted.

  • Deformation of machine under dynamic conditions. The final error type has to do with inertia and the effects of bending. When an object begins to move, it bends, and when it stops, it bends back. Perhaps it even vibrates like the proverbial arrow striking a tree.


  • Source: Mahr Federal Inc.

    Development of Error Compensation

    Errors of mechanical motion are nothing new, of course, and efforts to compensate for them have been around for many years as well. Early clockmakers had mechanisms to make their clocks more accurate, and “corrector bars” or “corrector systems” for both metrology systems and machine tools have been documented as early as 1760.

    But it is only in the past 30 years or so, with the advent of readily available and affordable computing technology, that error compensation has come into common practice. The methods available can be classified into three general categories-simple static, static plus dynamic and real time.

  • Simple Static Error Compensation. Nearly all machines that are error compensated use the simple static model. Application of this model is fairly straightforward. In order to eliminate straightness error from a guideway, the machine is moved slowly along the way while the out-of-straightness is measured with some other system with a higher level of accuracy such as a laser interferometer, or known artifacts like optical flats, cylinders for cylindricity machines or master balls for roundness testers. This error information is stored in the machine’s controller and when measurements are made, the error information is subtracted from the actual measurement to obtain a corrected measurement.

    The same simple static approach can be used to compensate for errors of position and errors of angularity.

    This brings us back to the customer who wanted to know if our machines were error compensated, yes or no? Which errors? Not all machine manufacturers compensate for all types of static error, and knowing which can be a very important consideration.

    Even more important is how these errors are compensated. Looking again at the example of straightness, are the guideways measured using a laser interferometer or an optical flat? There are differences. These independent systems and artifacts are very good-most probably better than the machine-but even they are not perfect. However, there are techniques that can be used to improve compensation data accuracy. For example, make multiple measurements and use the redundancy in the measurements to separate the error from the machine and the error from the artifact, and find the errors of both.

    With angularity errors, you have to measure the same kinds of things you do for straightness, but you also have to know about the geometry of your machine, how it is built, and what the distance is between the scale system and the probe tip. You need to know how accurate the scale system is, and whether the manufacturer mounted the checking system by the scale or the probe itself in developing the error compensation data file. If it was mounted on the scale, you may need to additionally correct for the probe geometry. Again, understanding what is being corrected and how it is being corrected has a major impact on the quality of the error compensation system, and ultimately on the accuracy of the machine.


  • Truly practical real-time error compensation requires enough computer power to process large amounts of data very quickly. Each axis or guideway of this system has a corresponding reference bar and each reference bar has a set of capacitor sensors that can measure all six degrees of freedom for that axis. Thus, if there is any pitch and yaw during movement down one guideway, the system can compensate for it immediately. Source: Mahr Federal Inc.

    Let’s look at another example-that of a roundness or cylindricity machine as shown in the illustration “Reversal Measurement Example.” To determine error compensation, a series of reversal measurements is used. First, trace up one side of an artifact or “perfect” cylinder and obtain a profile, P1. The profile is a combination of whatever errors are in the machine axis, plus whatever errors may exist in the cylinder.

    Next, rotate the cylinder so the traced side is opposite the column. Then mount a different probe and reach around the cylinder and trace the same path again. This profile, P2, also contains errors from the machine and the artifact, but those of the artifact are now reversed by 180 degrees. Add the two profiles together and divide the result by 2 to get the machine error without the effect of any errors in the cylinder.

  • Static Plus Dynamic Error Compensation. Static error compensation only accounts for static errors. Drop an engine block onto the measuring plate or move the machine quickly and all bets are off. However, by knowing what the deformations of load or motion are, it should be possible to build a computer model that predicts how the machine reacts under certain loads and at certain speeds. Then it should be possible to add in the known static error to generate a total error value.

    However, as interesting as this theoretical possibility is, it has not yet been proven practical. Machine geometry is of such complexity, and the possible variations of part weight and motion are so numerous that machines that use such a system are not in commercial use. A number of universities have theorized about it, and tried to develop models to do it, but when they attempted to apply those models to machines, the results have always been: “it doesn’t work very well.”

  • Real-Time Error Compensation. While predicting the effects of load and motion in a dynamic error model may be problematic, measuring them while they happen is possible. Indeed, the idea of real-time error compensation has been around a long time but lacked the computer power to process enough data fast enough to make it practical. The basic idea is to have a measuring machine to measure the part and another machine to measure the measuring machine. And this second measuring machine must be undisturbed by the weight of the parts and the speed of motion of the machine that is measuring the parts.

    If that sounds simple, it is not. For every axis in the machine that measures a part, there has to be some parallel type of system that measures what is happening to that axis as it is measuring the part. That is difficult to build without all these axes getting in each other’s way. But it can be done, and when the concept was first really put forth, it was referred to as having “a machine within a machine” or “a machine frame and a metrology frame.”


  • Using real-time error compensation, this system is designed to take reference quality 3-D and form measurements onto the shop floor. In addition to traditional form and position measurements such as cylindricity, concentricity and parallelism, the system also accurately measures diameter and angle on parts such as sealing cones, and a wide range of other features. Source: Mahr Federal Inc.

    The earliest known example of such a metrology frame was on a Rogers-Bond Universal Comparator, which was described in detail in 1883 to the American Academy of Arts and Sciences. One of the stated design requirements was “… the complete separation of the standards to be compared from the frame-work to which the microscopes are attached.” This requirement was met by mounting the microscope carriage on “independent piers.”

    For modern machine tools and scanning metrology machines only a few examples of this exist in regular use. Most examples are in national laboratories and academic institutions. One of the earliest documented examples in the modern era is the large optics diamond turning machine (LODTM) at the Lawrence Livermore National Laboratory. This machine was developed in the days of the Strategic Defense Initiative-euphemistically known as Star Wars-when they needed to make very large, very high precision optics that could focus on targets and direct missiles, and where even very tiny angular errors had to be eliminated. The LODTM is a machine tool that uses a single-point diamond as the tool to remove tiny precise amounts of material from whatever it is that it is machining.

    Lawrence Livermore reported in 1983 that they had a separate metrology frame around this machine that used laser interferometers to measure the positioning of the diamond turning system and was able to take into account things such as the cutting force of the diamond and the corresponding machine distortion. These LODTMs are considered by many to be the highest precision machining devices built to date.

    Other examples from national laboratories and research institutes can be found throughout the world. These include a machine built by the National Standards Lab in Switzerland which used a machine frame and a metrology frame to provide super-high precision measurement within a very small volume-80 by 80 by 38 millimeters-for high-precision Swiss watch components. While interesting technology, machines such as this are of limited interest due to their lack of availability to industry at large.

  • Commercial Real-Time Error Compensation. As already noted, truly practical real-time error compensation requires enough computer power to process large amounts of data very quickly. Thus, the last few years have seen the introduction of several such systems.

    With today’s computing power, a number of metrology systems for the measurement of form errors and gear tooth profiles are available which use real-time metrology frame-based error compensation, and they will become much more prevalent now that the computing technology is available to do it at a reasonable price and a reasonable speed. These machines offer the highest level of capability possible and render the simple questions such as what errors are present in the straightness of a machine guideway obsolete. By using these types of systems, the user is able to achieve real-world results at previously unattainable levels of capability.

    If in the market for a metrology system, understand that error compensation is a good feature, but it is not a simple yes or no question. First, there are five sources of error and you need to worry about them all.

    Second you need to know how the error compensation is being done, and even if it is just simple static, what techniques are being used and to what extent needs to be known.

    Finally, if part weight or machine motion are factors in the measurement process, consider systems that employ real-time, metrology frame error compensation.

    In short, instead of a “yes” or “no” check box on your criteria matrix, you should probably think about a matrix just for error compensation. Q


  • Tech Tips

  • Excluding temperature, which requires separate compensation techniques, there are five different types of mechanical error.

  • In the world of metrology systems, error compensation is generally considered to be the capability to apply corrections for undesirable or unplanned errors in positioning or motion.

  • Error compensation is typically used to increase the capability of the machine or to decrease the cost of manufacture for a given system.


  • Quality Online

    For more information on error compensation, visit www.qualitymag.com to read the following articles: