Abstract
With the availability of low-latency wireless communication and low-delay video communication solutions, vision-based networked control systems (NCS) become feasible. In this paper, we describe an NCS testbed which is suitable for the evaluation of the interplay of computer vision algorithms, network protocols and control algorithms under a delay constraint. The system comprises an inverted pendulum which is monitored by a video camera. The h.264-encoded video is sent over a network to an image processing computer. This computer extracts the angle of inclination of the pendulum from the decoded video and sends it over a wireless link to the pendulum. The pendulum uses the angle in a control algorithm to keep itself in a vertical position. We provide a detailed description of the system including the control algorithm and the image processing algorithms, and analyse the latency contributors of the system. The build instructions and source code of the testbed are publicly available. As the testbed is based on standard low-priced components, it is particularly suitable for educational purposes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The source code and setup instructions are available in the following GitHub repository: https://github.com/cbachhuber/PendulumTestBed.
- 2.
www.ev3dev.org, accessed on 06.04.2017.
- 3.
http://jwiger.blogspot.de/2012/09/the-lego-tire-test.html, accessed on 05.04.2017.
References
x264 - a free open-source h.264 encoder. http://www.videolan.org/developers/x264.html. 30 Jan 2017
Alt, N., Steinbach, E.: Visuo-haptic sensor for force measurement and contact shape estimation. In: Proceedings of IEEE International Symposium on Haptic Audio Visual Environments and Games (HAVE), pp. 24–28 (2013)
Bachhuber, C., Steinbach, E.: A system for high precision glass-to-glass delay measurements in video communication. In: Proceedings of IEEE International Conference on Image Processing (ICIP), pp. 2132–2136 (2016)
Bachhuber, C., Steinbach, E.: Are today’s video communication solutions ready for the tactile internet? In: IEEE Wireless Communications and Networking Conference Workshops (WCNCW) (2017)
Boccardi, F., et al.: Five disruptive technology directions for 5G. IEEE Commun. Mag. 52(2), 74–80 (2014)
Bonafilia, B., et al.: Self-Balancing Two-wheeled Robot (2015)
Bradski, G.: Open source CV library. Dr. Dobb’s J. Softw. Tools (2000)
Chan, R.P.M., Stol, K.A., Halkyard, C.R.: Review of modelling and control of two-wheeled robots. Ann. Rev. Control 37(1), 89–103 (2013)
Chen, C.C., Wu, H., Kühnlenz, K., Hirche, S.: Switching control for a networked vision-based control system. Automatisierungstechnik Methoden und Anwendungen der Steuerungs-, Regelungs-und Informationstechnik 59(2), 124–133 (2011)
Eide, R., et al.: LQG control design for balancing an inverted pendulum mobile robot. Intell. Control Autom. 2(02), 160 (2011)
Eker, J., Cervin, A., Hörjel, A.: Distributed wireless control using bluetooth. In: Proceedings of the IFAC Conference on New Technologies for Computer Control (2001)
Espinoza-Quesada, E., Ramos-Velasco, L.: Visual servoing for an inverted pendulum using a digital signal processor. In: 2006 IEEE International Symposium on Signal Processing and Information Technology (2006)
Hirata, K., Kimura, Y., Sugimoto, K.: Visual feedback control of cart-pendulum systems with webcam. In: IEEE International Conference on Mechatronics (ICM), pp. 1–6. IEEE (2007)
Kizir, S., Ocak, H., Bingul, Z., Oysu, C.: Time delay compensated vision based stabilization control of an inverted pendulum. Int. J. Innov. Comput. Inf. Control 8(12), 8133–8145 (2012)
Milton, J., Cabrera, J.L., Ohira, T., Tajima, S., Tonosaki, Y., Eurich, C.W., Campbell, S.A.: The time-delayed inverted pendulum: implications for human balance control. Chaos: Interdisc. J. Nonlinear Sci. 19(2), 026110 (2009)
Ooi, R.C.: Balancing a two-wheeled autonomous robot. University of Western Australia 3 (2003)
Tu, Y.W., Ho, M.T.: Design and implementation of robust visual servoing control of an inverted pendulum with an fpga-based image co-processor. Mechatronics 21(7), 1170–1182 (2011)
Wang, H., et al.: Hybrid control for vision based cart-inverted pendulum system. In: American Control Conference, pp. 3845–3850. IEEE (2008)
Wenzel, L., Vazquez, N., Nair, D., Jamal, R.: Computer vision based inverted pendulum. In: Proceedings of the 17th IEEE Instrumentation and Measurement Technology Conference, IMTC 2000, vol. 3, pp. 1319–1323. IEEE (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Bachhuber, C., Conrady, S., Schütz, M., Steinbach, E. (2017). A Testbed for Vision-Based Networked Control Systems. In: Liu, M., Chen, H., Vincze, M. (eds) Computer Vision Systems. ICVS 2017. Lecture Notes in Computer Science(), vol 10528. Springer, Cham. https://doi.org/10.1007/978-3-319-68345-4_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-68345-4_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-68344-7
Online ISBN: 978-3-319-68345-4
eBook Packages: Computer ScienceComputer Science (R0)