Skip to main content
SpringerLink
Log in

Molded article picking robot using image processing technique and pixel-based visual feedback control

  • Original Article
  • Published:
Artificial Life and Robotics Aims and scope Submit manuscript

Abstract

This paper aims to develop a robotic system that is able to find and remove unwanted molded articles, which fell in a narrow metallic mold space. Currently, this task is being supported by skilled workers. The proposed robotic system has the ability to estimate the orientation of articles using transfer learning-based convolutional neural networks (CNNs). The orientation information is essential and indispensable to realize stable robot picking operations. In addition, pixel-based visual feedback (PBVF) controller is introduced by referring to the center of gravity (COG) position of articles computed by image processing techniques. Hence, it is possible to eliminate the complex calibration between the camera and the robot coordinate systems. The implementation and effectiveness of the pick and place robot are demonstrated, where the conventional calibration of such task is not required.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Kragic D, Christensen HI (2002) Survey on visual servoing for manipulation. In: Computational vision and active perception laboratory technical report, Department of Numerical Analysis and Computing Science, Stockholms University, p 59

  2. Taryudi, Wang MS (2017) 3D object pose estimation using stereo vision for object manipulation system. In: Proceedings of 2017 international conference on applied system innovation (ICASI), Sapporo, Japan, 13–17 May 2017, pp 1532–1535

  3. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115:211–252

    Article  MathSciNet  Google Scholar 

  4. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Proceedings of advances in neural information processing systems, Lake Tahoe Nevada, USA, 3–6 Dec 2012, pp 1097–1105

  5. Haochen L, Bin Z, Xiaoyong S, Yongting Z (2017) CNN-based model for pose detection of industrial PCB. In: Proceedings of international conference on intelligent computation technology and automation (ICICTA), vol 1, Changsha, China, 9–10 Oct 2017, pp 390–393

  6. Miki K, Nagata F, Watanabe K (2020) Defective article picking robot in narrow metal mold space using image processing technique. In: Proceedings of the 2020 JSME conference on robotics and mechatronics (ROBOMECH2020), Kanazawa, Japan, 27–30 May 2020, 2P2-B03, p 4 (in Japanese)

  7. Miki K, Nagata F, Watanabe K, Habib MK (2021) Picking robot of defective molded articles using image processing technique and visual feedback control. In: Proceedings of 26th international symposium on artifical life and robotics (AROB 26th 2021), Oita, Japan, 21–23 Jan 2021, pp 498–502

  8. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: Proceedings of international conference on learning representations 2015 (ICLR2015), San Diego, CA, USA, 7–9 May 2015, p 14

  9. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of conference on computer vision and pattern recognition (CVPR), Boston, MA, USA, 7–12 June 2015, pp 1–9

  10. Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359

    Article  Google Scholar 

  11. Nagata F, Miki K, Otuka A, Yoshida K, Watanabe K, Habib MK (2020) Pick and place robot using visual feedback control and transfer learning-based CNN. In: Proceedings of IEEE international conference on mechatronics and automation (ICMA), Beijing, China, 13–16 Oct 2020, pp 850–855

  12. Tharwat A (2020) Classification assessment methods. Appl Comput Inf 17(1):168–192

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Engineering, Sanyo-Onoda City University, 1-1-1 Daigaku-Dori, Sanyo-Onoda, 756-0884, Japan

    Kohei Miki, Fusaomi Nagata & Takeshi Ikeda

  2. Graduate School of Natural Science and Technology, Okayama University, Okayama, Japan

    Keigo Watanabe

  3. Mechanical Engineering Department, School of Sciences and Engineering, American University in Cairo, Cairo, Egypt

    Maki K. Habib

Authors
  1. Kohei Miki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fusaomi Nagata
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Takeshi Ikeda
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Keigo Watanabe
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Maki K. Habib
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fusaomi Nagata.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was presented in part at the 26th International Symposium on Artificial Life and Robotics (Online, January 21–23, 2021).

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Miki, K., Nagata, F., Ikeda, T. et al. Molded article picking robot using image processing technique and pixel-based visual feedback control. Artif Life Robotics 26, 390–395 (2021). https://doi.org/10.1007/s10015-021-00692-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10015-021-00692-0

Keywords

Search

Navigation