Abstract
Over the past two decades, a major part of the manufacturing and assembly market has been driven by the increasing demand for customised products. This has created the need for smaller batch sizes, shorter production times, lower costs, and the flexibility to produce families of products—or to assemble different parts—with the same sets of equipment. Consequently, manufacturing companies have deployed various automation systems and production strategies to improve their resource efficiency and move towards right-first-time production. Threaded fastening operations are widely used in assembly and are typically time-consuming and costly. In high-volume production, fastening operations are commonly automated using jigs, fixtures, and semi-automated tools. However, in low-volume, high-value manufacturing, fastening operations are carried out manually by skilled workers. The existing approaches are found to be less flexible and robust for performing assembly in a less structured industrial environment. This motivated the development of a flexible solution, which does not require fixtures and is adaptable to variation in part locations and lighting conditions. As a part of this research, a novel 3D threaded hole detection and a fast bolt detection algorithms are proposed and reported in this article, which offer substantial enhancement to the accuracy, repeatability, and the speed of the processes in comparison with the existing methods. Hence, the proposed method is more suitable for industrial applications. The development of an automated bolt fastening demonstrator is also described in this article to test and validate the proposed identification algorithms on complex components located in 3D space.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Bogue R (2012) Europe fights back with advanced manufacturing and assembly technologies. Assem Autom 32(4):312–317
Michalos G, Makris S, Papakostas N, Mourtzis D, Chryssolouris G (2010) Automotive assembly technologies review: challenges and outlook for a flexible and adaptive approach. CIRP J Manuf Sci Technol 2(2):81–91
M. Klingajay, L. D. Seneviratne, and K. Althoefer, Identification of threaded fastening parameters using the Newton Raphson Method, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453). IEEE
M. Holzer, Aircraft fasteners, Aviationpros.com , 2011. [Online]. Available: http://www.aviationpros.com/article/10370291/aircraft-fasteners. [Accessed: 25-Oct-2016]
Tsarouchi P, Makris S, Michalos G, Stefos M, Fourtakas K, Kaltsoukalas K, Kontrovrakis D, Chryssolouris G (2014) Robotized assembly process using dual arm robot. Procedia CIRP 23:47–52
Finetto C, Rosati G, Faccio M, Rossi A (2015) Implementation framework for a fully flexible assembly system (F-FAS). Assem Autom 35(1):114–121
Rosati G, Faccio M, Barbazza L, Rossi A (2015) Hybrid fexible assembly systems (H-FAS): bridging the gap between traditional and fully flexible assembly systems. Int J Adv Manuf Technol 81(5–8):1289–1301
Herakovic N (2010) Robot vision in industrial assembly and quality control processes. In: Robot Vision. InTech
Fei N, Zhuang F, Renqiang L, Qixin C, Yanzheng Z (2007) An image processing approach for jigsaw puzzle assembly. Assem Autom 27(1):25–30
S. Pitipong, P. Pornjit, and P. Watcharin (2010) An automated four-DOF robot screw fastening using visual servo, 2010 IEEE/SICE International Symposium on System Integration. IEEE
Chen H, Zhang G, Zhang H, Fuhlbrigge TA (Aug. 2007) Integrated robotic system for high precision assembly in a semi-structured environment. Assem Autom 27(3):247–252
Chen H, Wang J, Zhang G, Fuhlbrigge T, Kock S (Dec. 2009) High-precision assembly automation based on robot compliance. Int J Adv Manuf Technol 45(9–10):999–1006
Peña-Cabrera M, Lopez-Juarez I, Rios-Cabrera R, Corona-Castuera J (2005) Machine vision approach for robotic assembly. Assem Autom 25(3):204–216
Ilangovan B, Monfared RP, Jackson M (2016) An automated solution for fixtureless sheet metal forming. Int J Adv Manuf Technol 82(1–4):315–326
Kalt E, Monfared R, Jackson M Towards an automated polishing system—capturing manual polishing operations. Int J Res Eng Technol 05(07):182–192
Jayaweera N, Webb P (2010) Metrology-assisted robotic processing of aerospace applications. Int J Comput Integr Manuf 23(3):283–296
N. D. Jayaweera, H. M. R. A. Herath, P. A. P. Madushanka, H. P. C. Sampath, and J. H. A. S. Jayamaha (2017) Development of a best-fit algorithm for feature based assembly, in 2017 Moratuwa Engineering Research Conference (MERCon), pp. 203–208
Bone GM, Capson D (2003) Vision-guided fixtureless assembly of automotive components. Robot Comput Integr Manuf 19(1–2):79–87
Fleischer J, Lanza G, Otter M, Elser J (2013) Spatial alignment of joining partners without fixtures, based on component-inherent markings. J Manuf Syst 32(3):489–497
Munich S. Winkelbach, and FM Wahl, G German Conference on Robotics (2010) Ransam for industrial bin-picking. VDE Conference Department, 2010
Böhnke K, Gottscheber A (2010) Fast object registration and robotic bin picking. Springer, Berlin, Heidelberg, pp 23–37
S. Lee, J. Kim, M. Lee, K. Yoo, L. G. Barajas, and R. Menassa 2012 3D visual perception system for bin picking in automotive sub-assembly automation, in 2012 IEEE International Conference on Automation Science and Engineering (CASE), pp. 706–713
Oh J-K, Lee S, Lee C-H (2012) Stereo vision based automation for a bin-picking solution. Int J Control Autom Syst 10(2):362–373
B. Drost, M. Ulrich, N. Navab, and S. Ilic (2010) Model globally, match locally: efficient and robust 3D object recognition, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE
Xu J, Chen R, Chen H, Zhang S, Chen K (2017) Fast registration methodology for fastener assembly of large-scale structure. IEEE Trans Ind Electron 64(1):717–726
A. Aldoma, M. Vincze, N. Blodow, D. Gossow, S. Gedikli, R. B. Rusu, and G. Bradski (2011) CAD-model recognition and 6DOF pose estimation using 3D cues, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops). IEEE
H. Chen and B. Bhanu (2004) 3D free-form object recognition in range images using local surface patches, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. IEEE
E. Wahl, U. Hillenbrand, and G. Hirzinger (2003) Surflet-pair-relation histograms: a statistical 3D-shape representation for rapid classification, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings. IEEE
K. Khoshelham, Extending generalized Hough transform to detect 3D objects in laser range data
P. S. Ogun, Z. Usman, K. Dharmaraj, and M. R. Jackson (2015) 3D vision assisted flexible robotic assembly of machine components, p. 98751O
Y. Wang, R. Liu, F. Li, S. Endo, T. Baba, and Y. Uehara An effective hole detection method for 3D models
G. H. Bendels and R. Klein (2006) Detecting holes in point set surfaces, 14-th Int Conf Cent Eur Comput Graph Vis Comput Vis, pp. 89–96
C. Papazov and D. Burschka (2011) An efficient RANSAC for 3D object recognition in noisy and occluded scenes, in Lect Notes Comput Sci (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6492 LNCS, no. PART 1, pp. 135–148
Borrmann D, Elseberg J, Lingemann K, Nüchter A (2011) The 3D Hough transform for plane detection in point clouds: a review and a new accumulator design. 3D Res 2(2):1–13
K. Dharmaraj (2015) Automated freeform assembly of threaded fasteners, Loughborough University, https://dspace.lboro.ac.uk/2134/19624
Optical Gaging Products (OPG) (2014) SmartScope Flash 200
Funding
The study was supported by the EPSRC Centre for Innovative Manufacturing in Intelligent Automation, in undertaking this research work under grant reference number EP/IO33467/1.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Dharmara, K., Monfared, R.P., Ogun, P.S. et al. Robotic assembly of threaded fasteners in a non-structured environment. Int J Adv Manuf Technol 98, 2093–2107 (2018). https://doi.org/10.1007/s00170-018-2363-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00170-018-2363-5