In aerospace projects, there are no “do overs.” Even minor errors can prove expensive or deadly. NASA’s $125 million Mars Climate Observer burned up in the Martian atmosphere when the manufacturer gave NASA English measurements for thrust, rather than metric units. A loose piece of foam cost seven shuttle astronauts their lives.
But careless mishaps also take place on the manufacturing floor. In 2003, for example, the U.S. National Oceanographic and Atmospheric Administration’s $233 million NOAA-N Prime weather satellite was severely damaged by falling three feet to a concrete floor at Lockheed Martin’s satellite factory in Sunnyvale, CA. When one crew failed to document that it had removed two dozen bolts from a cart used to turn the satellite over, and the other crew failed to follow procedures and check that the bolts were in place before moving the satellite, the end result was a $135 million repair bill.
Missing bolts, then, can certainly be a problem. But so are over- or undertorqued bolts and rivets. That’s why Six Sigma Black Belt Vu D. Pham of Boeing took on the task of improving the accuracy of the torquing at his plant. Along the way, he not only improved the accuracy, but by using a PDA-based calibration verification system from Mountz Inc. (San Jose, CA), also found a way to save the company a lot of money.
“We calculate that real savings for the first year was a couple hundred thousand dollars,” says Pham, leader of engineering assurance at Boeing’s Satellite Development Center (SDC, El Segundo, CA). “This is just the raw savings of not sending tools out for calibration, and doesn’t include our savings on failures, repairs and personnel costs.”
In December 2006, Boeing Space and Intelligence Systems (S&IS) was named as one of the two Gold-level recipients of the California Awards for Performance Excellence, the statewide equivalent of the Malcolm Baldrige Award. SDC is a part of S&IS.
Calibration ConundrumBoeing’s SDC is the world’s largest satellite manufacturer, with more than 200 commercial communication satellite launches since 1963, in addition to military and weather satellites and spacecraft. The SDC’s 1-million-square-foot manufacturing facility has more than a dozen satellites under construction at any given time, primarily its 601 and 702 series of body-stabilized communications models, as well as two lines of mobile communications satellites. Pre-launch testing includes subjecting them to spin rates of 30 to 100 rpm, as well as vibrations and sound similar to what they would experience during launch-up to 50,000 pounds of force and 165 decibels. To test their ability to withstand the rigors of space, satellites are placed in a thermal vacuum chamber and subjected to temperatures of -320 F to 250 F while powered up and with instruments operating.
The facility has received both the Software Engineering Institute’s Capability Maturity Model Integration (CMMI) Level 5 (Optimizing) certification and AS 9100 certification. AS 9100 is made up of the ISO 9001: 2000 standard with additional aerospace-specific requirements. Part of the SDC’s quality control program, for example, is complying with ANSI/NCSL Z540-1-1994 calibration standards.
“To meet those requirements, a torque verification system has to include maintaining the history of each torque and the calibration data,” says Senior Calibration Engineer William K. Jinbo. “A quality control person would actually monitor the whole process of the bolt torquing, from the beginning of obtaining the wrench to the very end after the torquing is done. Then they would have to maintain the data and history of the torque.”
It also meant that each torque tool needed to be sent outside for calibration-an expensive proposition considering that SDC has 3,500 torque tools.
“I had a task to improve the quality of the torque tools that were causing the overtorque,” says Pham. “To achieve this, we first had to conduct a study of root causes using the standard Six Sigma tools. This entailed looking at the people, systems, processes and methods, as well as the torque tools themselves.”
One thing that Pham and his team looked at was whether the gages were correctly calibrated or were the culprit. They conducted a study of repeatability and reproducibility and found that the tools were out of calibration, some by as much as a factor of 1.5 or 2, despite being sent to a third party for calibration.
Even though they were within tolerance, they were still subject to operator error. The tools were spring loaded and different operators would pull them different amounts after hearing the click. The solution in place to fix this issue was to have an inspector listen for the click to ensure the component was not under- or overtorqued. But even this was not consistent.
Then there was the issue of usability of the tools.
“With some of our tools, we could not change the torque values quickly enough so we used different tools for different torque values,” says Pham. This prompted Boeing to look at other options.
Three-Phase ImprovementBased on the initial evaluation of problems with the existing torque system, Pham and his team began a three-phase project to address the issues. Phase one was to locate tools that were more accurate and consistent than what they had been using. They investigated several manufacturers. Pham’s boss, Director of Engineering Quality Dan Pace, had worked with Mountz tools at a previous company, and recommended that they be considered.
“We found that the Mountz tools could produce repeatability and reproducibility,” says Pham. “We tried them with different operators and different values, and they came very close to Six Sigma values.”
While that alone would have made a significant improvement in operations, that was not enough. That led to phase two-ensuring the tool was accurate every time, not just after annual calibrations.
“Even though the tool is good, what guarantee is there that if it is dropped it will still be calibrated?” says Pham. “So I challenged the vendor to come up with a portable calibration system that we can bring to the point of use and test the tool before we use it. That way we will know if the values have shifted.”
The supplier came back to Boeing with a laptop loaded with the verification software, but Pham rejected that solution as being too cumbersome to work with in the confined spaces around a satellite. So, at Pham’s request, a PDA-based version was developed, mounted on the tool cart. This met Boeing’s requirements. The final system included:
- 12 Mountz Wizard Plus PDA handheld torque displays/calibration systems
- 27 Mountz BMX torque sensors
- An assortment of Mountz specialty cam-over and break-over wrenches and screwdrivers.
“We can verify at the point of use, prior to installing something, that we have a good value,” Pham says. “My communication to the calibration department was, ‘If we can do this here now, why should we send these tools out for calibration? It doesn’t make sense.’”
After some back and forth it was determined that Boeing could meet the NIST calibration requirements in-house. Instead of sending out all the thousands of tools for calibration, only the Mountz equipment needed to receive third-party testing.
“The only thing we have to send out is the torque sensor and the Mountz PDA for calibration-five pieces instead of thousands,” he says.
Reproducing SuccessJinbo admits that he was not sure in the beginning whether the system would work. “I was first of all fairly skeptical about being able to have a torque verification system at the point of use,” he says. “Several factors determine the accuracy including the actual person doing the torque and whether he or she has the right technique. If they don’t have the right technique, that will create a problem as far as torque is concerned.” But, after seeing it in action, he is pleased with the results and says the system has also gotten a positive response from the technicians who use it.
“The main reason for it being on the floor is to have confidence in the level of torque before the torque is done,” Jinbo says. “It makes it easier for the technicians, and they don’t have to worry about broken bolts from overtorquing or not applying enough torque.”
- Boeing not only improved their accuracy by using a PDA-based calibration verification system from Mountz Inc., but also found a way to save money.
- Mountz tools produced repeatability and reproducibility, and came close to Six Sigma values.
- system makes it easier for the technicians so they no longer have to worry about broken bolts from overtorquing or not applying enough torque.