Skip to main content

Spatial Resolution Metric for Optimal Viewpoints Generation in Visual Inspection Planning

  • Conference paper
  • First Online:
Computer Vision Systems (ICVS 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14253))

Included in the following conference series:

  • 503 Accesses

Abstract

The automation of visual quality inspection is becoming increasingly important in manufacturing industries. The objective is to ensure that manufactured products meet specific quality characteristics. Manual inspection by trained personnel is the preferred method in most industries due to the difficulty of identifying defects of various types and sizes. Sensor placement for 3D automatic visual inspection is a growing computer vision and robotics area. Although some methods have been proposed, they struggle to provide high-speed inspection and complete coverage. A fundamental requirement is to inspect the product with a certain specific resolution to detect all defects of a particular size, which is still an open problem. Therefore, we propose a novel model-based approach to automatically generate optimal viewpoints guaranteeing maximal coverage of the object’s surface at a specific spatial resolution that depends on the requirements of the problem. This is done by ray tracing information from the sensor to the object to be inspected once the sensor model and the 3D mesh of the object are known. In contrast to existing algorithms for optimal viewpoints generation, our approach includes the spatial resolution within the viewpoint planning process. We demonstrate that our approach yields optimal viewpoints that achieve complete coverage and a desired spatial resolution at the same time, while the number of optimal viewpoints is kept small, limiting the time required for inspection.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://owncloud.fraunhofer.de/index.php/s/H8jV9rwGN84knzP (Accessed August 19, 2023).

References

  1. Almadhoun, R., Taha, T., Seneviratne, L., Dias, J., Cai, G.: A survey on inspecting structures using robotic systems. Int. J. Adv. Rob. Syst. 13(6), 1–18 (2016)

    Google Scholar 

  2. Connolly, C.: The determination of next best views. In: IEEE International Conference on Robotics and Automation, vol. 2, pp. 432–435 (1985)

    Google Scholar 

  3. Englot, B.J.: Sampling-based coverage path planning for complex 3D structures. Ph.D. thesis, Massachusetts Institute of Technology (2012). http://hdl.handle.net/1721.1/78209

  4. Gospodnetić, P., Mosbach, D., Rauhut, M., Hagen, H.: Viewpoint placement for inspection planning. Mach. Vis. Appl. 33(1), 1–21 (2022)

    Article  Google Scholar 

  5. Gronle, M., Osten, W.: View and sensor planning for multi-sensor surface inspection. Surf. Topogr. Metrol. Prop. 4(2), 777–780 (2016)

    Article  Google Scholar 

  6. Jing, W., Polden, J., Lin, W., Shimada, K.: Sampling-based view planning for 3D visual coverage task with unmanned aerial vehicle. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1808–1815 (2016)

    Google Scholar 

  7. Karaszewski, M., Adamczyk, M., Sitnik, R.: Assessment of next-best-view algorithms performance with various 3D scanners and manipulator. ISPRS J. Photogramm. Remote Sens. 119, 320–333 (2016)

    Article  Google Scholar 

  8. Marschner, S., Shirley, P.: Fundamentals of Computer Graphics. CRC Press (2018)

    Google Scholar 

  9. Mohammadikaji, M.: Simulation-Based Planning of Machine Vision Inspection Systems with an Application to Laser Triangulation, vol. 17. KIT Scientific Publishing (2020)

    Google Scholar 

  10. Mosbach, D., Gospodnetić, P., Rauhut, M., Hamann, B., Hagen, H.: Feature-driven viewpoint placement for model-based surface inspection. Mach. Vis. Appl. 32(1), 1–21 (2021)

    Article  Google Scholar 

  11. Prieto, F., Lepage, R., Boulanger, P., Redarce, T.: A CAD-based 3D data acquisition strategy for inspection. Mach. Vis. Appl. 15(2), 76–91 (2003)

    Article  Google Scholar 

  12. Sakane, S., Sato, T.: Automatic planning of light source and camera placement for an active photometric stereo system. In: IEEE International Conference on Robotics and Automation, pp. 1080–1081 (1991)

    Google Scholar 

  13. Scott, W.R.: Model-based view planning. Mach. Vis. Appl. 20(1), 47–69 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  14. Scott, W.R., Roth, G., Rivest, J.F.: Performance-oriented view planning for model acquisition. In: International Symposium on Robotics, pp. 212–219 (2000)

    Google Scholar 

  15. Scott, W.R., Roth, G., Rivest, J.F.: View planning for automated three-dimensional object reconstruction and inspection. ACM Comput. Surv. (CSUR) 35(1), 64–96 (2003)

    Article  Google Scholar 

  16. Sheng, W., Xi, N., Tan, J., Song, M., Chen, Y.: Viewpoint reduction in vision sensor planning for dimensional inspection. In: IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, vol. 1, pp. 249–254 (2003)

    Google Scholar 

  17. Staderini, V., Glück, T., Schneider, P., Mecca, R., Kugi, A.: Surface sampling for optimal viewpoint generation. In: 2023 IEEE 13th International Conference on Pattern Recognition Systems (ICPRS), pp. 1–7 (2023)

    Google Scholar 

  18. Tan, C.S., Mohd-Mokhtar, R., Arshad, M.R.: A comprehensive review of coverage path planning in robotics using classical and heuristic algorithms. IEEE Access 9, 119310–119342 (2021)

    Article  Google Scholar 

  19. Tarbox, G.H., Gottschlich, S.N.: Planning for complete sensor coverage in inspection. Comput. Vis. Image Underst. 61(1), 84–111 (1995)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vanessa Staderini .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Staderini, V., Glück, T., Mecca, R., Schneider, P., Kugi, A. (2023). Spatial Resolution Metric for Optimal Viewpoints Generation in Visual Inspection Planning. In: Christensen, H.I., Corke, P., Detry, R., Weibel, JB., Vincze, M. (eds) Computer Vision Systems. ICVS 2023. Lecture Notes in Computer Science, vol 14253. Springer, Cham. https://doi.org/10.1007/978-3-031-44137-0_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-44137-0_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-44136-3

  • Online ISBN: 978-3-031-44137-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics