Abstract
In the palletizing task, the three-dimensional size of the stack directly affects the working distance (i.e., depth) of the manipulator in the Z-axis direction. In order to complete the palletizing task accurately and reliably and realize human-computer interaction, it is necessary to obtain the three-dimensional structural characteristics of the pallet in real time. Therefore, this paper proposes a three-dimensional reconstruction of the single image of the grab based on the palletizing task. Firstly this paper converts the RGB image of the stack to a grayscale image, then uses the Canny method to detect the edge of the corresponding grayscale image, and uses the Hough line detection algorithm to extract the straight line in the edge image. By analyzing the characteristics of the straight line cluster. A stack is divided into three groups of straight lines in the horizontal, vertical, and vertical directions according to the angle characteristics of the straight line. The RANSAC algorithm is used to analyze and obtain the best linear model of the straight line in each direction. And the minimum distance method is used to solve the vanishing points in the three directions of horizontal, vertical and vertical, and then the internal and external parameters of the camera are calibrated according to the attributes of the vanishing points. A fast and high-precision rectangle detection algorithm is used to detect the coordinates of the vertices of the cuboid. In particular, the size of each cuboid part is consistent and known, so this paper combines the camera’s internal and external parameters with the geometric characteristics of the stack can get the length, width, and height and visual model of a real-time changing stack during the palletizing task. The experimental results show that this algorithm can well build a three-dimensional wireframe model of the stack, and realize the three-dimensional visualization of the model. The maximum error of the reconstructed model is 0.950, the minimum error is 0, and the average error is 0.217; the maximum length The error is 0.560, the minimum error is 0, and the average error is 0.187; the maximum error of the width is 0.950, the minimum error is 0.064, and the average error is 0.461; the maximum error of the height is 0.420, the minimum error is 0, and the average error is 0.14; the robot Z axis The maximum error of the working distance (i.e. depth) in the direction is 0.24, the minimum error is 0, and the average error is 0.08, which meets our actual modeling requirements.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Guillou, E., Meneveaux, D., Maisel, E., et al.: Using vanishing points for camera calibration and coarse 3D reconstruction from a single image. Vis. Comput. 16, 396–410 (2000)
Liu, Z., Wang, J., Chen, L.: The 3D reconstruction of a single image based on vanishing point optimization, 47(02), 180–185 (2019)
Wang, S., Fang, L., Chen, C., Huang, M.: A single view type 3D reconstructive method for architecture based on structured scene. J. Geo-Inf. Sci. 18(08), 1022–1029 (2016)
Qi, C.R., Litany, O., He, K., et al.: Deep hough voting for 3D object detection in point clouds. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 9277–9286 (2019)
Shin, D., Ren, Z., Sudderth, E.B., Fowlkes, C.C.: 3D scene reconstruction with multi-layer depth and epipolar transformers. In: The IEEE International Conference on Computer Vision (ICCV), pp. 2172–2182 (2019)
Zhou, Y., Qi, H., Zhai, Y., et al.: Learning to reconstruct 3D Manhattan wireframes from a single image. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 7698–7707 (2019)
Zhang, S., Liu, W.: Single image 3D reconstruction based on control point grid. Multimed. Tools Appl. 77, 31875–31893 (2018)
Zou, C., Liu, J., Liu, J.: Precise 3D reconstruction from a single image. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol. 7727. Springer, Heidelberg (2013)
Li, B., Peng, K., Ying, X.H., et al.: Vanishing point detection using cascaded 1D Hough Transform from single images. Pattern Recognit. Lett. 33(1), 1–8 (2012)
Wildenauer, H., Hanbury, A.: Robust camera self-calibration from monocular images of Manhattan worlds. In: CVPR 12 Proceeding of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2831–2838. IEEE Press, New York (2012)
Jun, C., Xu, X., Liang, C.: Un-calibrated single visual image of orthogonal vanishing point detection algorithm. J. Graph. 037(006), 783–790 (2016)
Wang, J.: Research on 3D reconstruction technology based on single image. Hebei University of Technology (2014)
Toldo, R., Fusiello, A.: Robust multiple structures estimation with j-linkage. In: Computer Vision–ECCV 2008, pp. 537–547. Springer, Heidelberg, (2008)
Shi, R.: Three-dimensional reconstruction based on single uncalibrated image. Qingdao University (2013)
Wang, J.: The 3D reconstruction of single image based on vanishing point optimization. Zhejiang University of Technology (2018)
Lu. L., Yang, J., Liang, J., Jiang, Y.: A fast and high precision rectangle detection algorithm. Laser Optoelectr. Progr. (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lu, L., Yang, J., Liang, J., Zhang, A. (2021). 3D Reconstruction of Grabbed Objects Using a Single Image Based on Palletizing Task. In: Cheng, LY. (eds) ICGG 2020 - Proceedings of the 19th International Conference on Geometry and Graphics. ICGG 2021. Advances in Intelligent Systems and Computing, vol 1296. Springer, Cham. https://doi.org/10.1007/978-3-030-63403-2_46
Download citation
DOI: https://doi.org/10.1007/978-3-030-63403-2_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63402-5
Online ISBN: 978-3-030-63403-2
eBook Packages: EngineeringEngineering (R0)