- Published:
Accurate measurement method for tube’s endpoints based on machine vision
Chinese Journal of Mechanical Engineering volume 30, pages 152–163 (2017)
Abstract
Tubes are used widely in aerospace vehicles, and their accurate assembly can directly affect the assembling reliability and the quality of products. It is important to measure the processed tube’s endpoints and then fix any geometric errors correspondingly. However, the traditional tube inspection method is time-consuming and complex operations. Therefore, a new measurement method for a tube’s endpoints based on machine vision is proposed. First, reflected light on tube’s surface can be removed by using photometric linearization. Then, based on the optimization model for the tube’s endpoint measurements and the principle of stereo matching, the global coordinates and the relative distance of the tube’s endpoint are obtained. To confirm the feasibility, 11 tubes are processed to remove the reflected light and then the endpoint’s positions of tubes are measured. The experiment results show that the measurement repeatability accuracy is 0.167 mm, and the absolute accuracy is 0.328 mm. The measurement takes less than 1 min. The proposed method based on machine vision can measure the tube’s endpoints without any surface treatment or any tools and can realize on line measurement.
References
ZHOU C, YIN Y H. Pipe assembly planning algorithm by imitating human imaginal thinking[J]. Assembly Automation, 2010, 30(1): 66–74.
LI H, YANG H, SONG F, et al. Springback characterization and behaviors of high-strength Ti-3Al-2.5 V tube in cold rotary draw bending[J]. Journal of Materials Processing Technology, 2012, 212(9): 1973–1987.
KAWASHIMA K, KANAI S, DATE H. As-built modeling of piping system from terrestrial laser-scanned point clouds using normal-based region growing[J]. Journal of Computational Design and Engineering, 2014, 1(1): 13–26.
SON H, BOSCH F, KIM C. As-built data acquisition and its use in production monitoring and automated layout of civil infrastructure: A survey[J]. Advanced Engineering Informatics, 2015, 29(2): 172–183.
JAHANSHAHI M R, MASRI S F. Adaptive vision-based crack detection using 3D scene reconstruction for condition assessment of structures[J]. Automation in Construction, 2012, 22: 567–576.
HEIST S, MANN A, KUHMSTEDT P, et al. Array projection of aperiodic sinusoidal fringes for high-speed three-dimensional shape measurement[J]. Optical Engineering, 2014, 53(11): 112208-1–112208-12.
HUANG J, LAN X, KAUR A, et al. Reflection-based phase-shifted long period fiber grating for simultaneous measurement of temperature and refractive index[J]. Optical Engineering, 2013, 52(1): 014404-1–014404-4.
WADE P, MORAN D, GRAHAM J, et al. Robust and accurate 3D measurement of formed tube using trinocular stereo vision[C]//The British Machine Vision Conference, Essex, UK, September 8–11, 1997: 1–10.
BERGAMASCO F, COSMO L, ALBARELLI A, et al. A robust multi-camera 3D ellipse fitting for contactless measurements[C]//2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, Zurich, Switzerland, October 13–15, 2012: 168–175.
OUELLET J N, HEBERT P. Precise ellipse estimation without contour point extraction[J]. Machine Vision and Applications, 2009, 21(1): 59–67.
USABIAGA J, EROL A, BEBIS G, et al. Global hand pose estimation by multiple camera ellipse tracking[J]. Machine Vision and Applications, 2009, 21(1): 1–15.
AHN S J, WARNECKE H, KOTOWSKI R. Systematic geometric image measurement errors of circular object targets: Mathematical formulation and correction[J]. The Photogrammetric Record, 1999, 16(93): 485–502.
JIN P, LIU J H, LIU S L, et al. Measuring method of pipeline endpoints based on two-dimensional point-target[J]. Computer Integrated Manufacturing Systems, 2014, 20(11): 2758–2766. (in Chinese)
SHAFER S A. Using color to separate reflection components[J]. Color Research & Application, 1985, 10(4): 210–218.
WOLFF L B, BOULT T E. Constraining object features using a polarization reflectance model[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 1991, 13(7): 635–657.
UMEYAMA S, GODIN G. Separation of diffuse and specular components of surface reflection by use of polarization and statistical analysis of images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(5): 639–647.
SATO Y, IKEUCHI K. Temporal-color space analysis of reflection[J]. Journal of the Optical Society of America A, 1994, 11(11): 2990–3002.
KLINKER G J, SHAFER S A, KANADE T. The measurement of highlights in color images[J]. International Journal of Computer Vision, 1988, 2(1): 7–32.
NOVAK C L, SHAFER S A. Anatomy of a color histogram [C]//1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Illinois, USA, June 15–18, 1992: 599–605.
CHING W S, TOH P S, ER M H. A new specular highlights detection algorithm using multiple views [C]//1993 International Conference on Information Engineering 93 Communications and Networks for the Year 2000, Singapore, September 6–11, 1993: 474–478.
WANG C Q, ZHU F W. Removing highly illuminated regions from a single image[J]. Journal of Shanghai university(Natural Science Edition), 2007, 13(2): 151–154. (in Chinese)
JIANG Y X, WANG X T, XU X G, et al. A method for image enhancement based on light compensation[J]. Acta Electronica Sinica, 2009, 37(4A): 151–155. (in Chinese)
BOSEMANN W. The optical tube measurement system OLM photogrammetric methods used for industrial automation and process control[J]. International Archives of Photogrammetry and Remote Sensing, 1996, 31(B5): 55–58.
NAYAR S K, IKEUCHI K, KANADE T. Surface reflection: physical and geometrical perspectives[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 1991, 13(7): 611–634.
SHASHUA A. Geometry and photometry in 3D visual recognition[D] Boston: Massachusetts Institute of Technology, 1992.
MUKAIGAWA Y, MIYAKI H, MIHASHI S, et al. Photometric image-based rendering for image generation in arbitrary illumination[C]//Proceedings of Eighth IEEE International Conference on Computer Vision, Vancouver, Canada, July 7–14, 2001: 652–659
FURUKAWA Y, PONCE J. Accurate camera calibration from multi-view stereo and bundle adjustment[C]//Proceedings of IEEE Conference on the Computer Vision and Pattern Recognition, Anchorage, USA, June 23–28, 2008: 1–8.
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by National Natural Science Foundation of China(Grant No. 51305031)
LU Shaoli, born in 1984, is currently a lecturer at Beijing Institute of Technology, China. She received her PhD degree from Tsinghua University, China, in 2012. Her main research interests include machine vision, on-line measurement, virtual assembly and image processing.
JIN Peng, born in 1987, is currently a PhD candidate at Beijing Institute of Technology, China. He received his master degree from North China Electricity Power University, China, in 2013. His research interests include machine vision and photogrammetry.
LIU Jianhua, born in 1977, is a professor, PhD advisor, and received his PhD degree in mechanical engineering from Beijing Institute of Technology, China. His scholastic interests include virtual assembly and machine vision. Now he has published over 60 research papers in virtual assembly.
WANG Xiao, born in 1989, is currently a PhD candidate at Beijing Institute of Technology, China. He received his bachelor degree from Beijing University of Chemical Technology, China, in 2014. His research interests include machine vision and photogrammetry.
SUN Peng, born in 1990, received his master degree from Beijing Institute of Technology, China, in 2015. His research interests include machine vision and photogrammetry.
Rights and permissions
About this article
Cite this article
Liu, S., Jin, P., Liu, J. et al. Accurate measurement method for tube’s endpoints based on machine vision. Chin. J. Mech. Eng. 30, 152–163 (2017). https://doi.org/10.3901/CJME.2016.0516.066
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3901/CJME.2016.0516.066