Journal of Intelligent & Robotic Systems

, Volume 77, Issue 3–4, pp 499–523 | Cite as

Robot Control System Design Exemplified by Multi-Camera Visual Servoing

  • Tomasz KornutaEmail author
  • Cezary Zieliński


The article investigates the problem of designing robot control systems. It starts with a brief overview of general control architectures, followed by the presentation of the design methodology based on the concept of an embodied agent. Multi-level decomposition of system structure enables the formulation of the operation of each of the resulting subsystems in terms of transition functions, specifying their state evolution. The paper also introduces mathematical and graphical notations, complementing each other, defining formally the control system behaviour. As an example the specification of a control system of a robot utilizing multi-camera visual servoing for object following is presented.


Robotics Control systems Agents Machine vision Visual servoing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Arbib, M.: Handbook of Physiology – The Nervous System II. Motor Control, chap. Perceptual Structures and Distributed Motor Control, pp. 1449–1480. Wiley Online Library (1981)Google Scholar
  2. 2.
    Arkin, R.C.: Behavior-Based Robotics. MIT Press (1998)Google Scholar
  3. 3.
    Bauml, B., Wimbock, T., Hirzinger, G.: Kinematically optimal catching a flying ball with a hand-arm-system. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2592–2599 (2010)Google Scholar
  4. 4.
    Boryń, M., Kornuta, T.: A controller tuning method for Visual Servoing (in Polish). In: Proceedings of the 12th National Conference on Robotics – Advances in Robotics, Scientific Papers – Electronics, vol. 2, pp. 617–626. Publishing House of Warsaw University of Technology (2012)Google Scholar
  5. 5.
    Brooks, R.: Elephants don’t play chess. Robot. Auton. Syst. 6(1–2), 3–15 (1990)CrossRefGoogle Scholar
  6. 6.
    Brooks, R.A.: A robust layered control system for a mobile robot. IEEE J. Robot. Autom. 2(1), 14–23 (1986)CrossRefGoogle Scholar
  7. 7.
    Brooks, R.A.: Intelligence without reason. Artif. Intell. Crit. Concepts 3, 107–63 (1991)Google Scholar
  8. 8.
    Brugali, D., Broten, G.S., Cisternino, A., Colombo, D., Fritsch, J., Gerkey, B., Kraetzschmar, G., Vaughan, R., Utz, H.: Trends in robotic software frameworks. In: Brugali, D. (ed.) Software Engineering for Experimental Robotics, pp. 259–266. Springer-Verlag (2007)Google Scholar
  9. 9.
    Chaumette, F., Hutchinson, S.: The Handbook of Robotics, chap. Visual Servoing and Visual Tracking, pp. 563–583. Springer (2008)Google Scholar
  10. 10.
    Dittes, B., Goerick, C.: A language for formal design of embedded intelligence research systems. Robot. Auton. Syst. 59(3–4), 181–193 (2011)CrossRefGoogle Scholar
  11. 11.
    Gat, E., et al.: On three-layer architectures. Artificial intelligence and mobile robots pp. 195–210 (1998)Google Scholar
  12. 12.
    Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. Prentice Hall (2002)Google Scholar
  13. 13.
    Hill, J., Park, W.: Real time control of a robot with a mobile camera. In: Proceedings of the 9th ISIR, pp. 233–246 (1979)Google Scholar
  14. 14.
    Hutchinson, S.A., Hager, G.D., Corke, P.I.: A tutorial on visual servo control. IEEE Trans. Robot. Autom. 12(5), 651–670 (1996)CrossRefGoogle Scholar
  15. 15.
    Kaisler, S.: Software Paradigms. Wiley Interscience (2005)Google Scholar
  16. 16.
    Kornuta, T., Stefańczyk, M.: DisCODe: a component framework for sensory data processing (in Polish). PAR 16(7–8), 76–85 (2012)Google Scholar
  17. 17.
    Lepetit, V., Moreno-Noguer, F., Fua, P.: Epnp: an accurate o (n) solution to the pnp problem. Int. J. Comput. Vis. 81(2), 155–166 (2009)CrossRefGoogle Scholar
  18. 18.
    Lyons, D.M.: Prerational intelligence, Studies in cognitive systems, vol. 2: Adaptive behavior and intelligent systems without symbols and logic, chap. A Schema-Theory Approach to Specifying and Analysing the Behavior of Robotic Systems, pp. 51–70. Kluwer Academic (2001)Google Scholar
  19. 19.
    Lyons, D.M., Arbib, M.A.: A formal model of computation for sensory-based robotics. IEEE Trans. Robot. Autom. 5(3), 280–293 (1989)CrossRefGoogle Scholar
  20. 20.
    Markiewicz, M., de Lucena, C.: Object oriented framework development. ACM XRDS 7(4), 3–9 (2001)CrossRefGoogle Scholar
  21. 21.
    Matarić, M.J., Michaud, F.: The Handbook of Robotics, chap. Behavior-Based Systems, pp. 891–909. Springer (2008)Google Scholar
  22. 22.
    Padgham, L., Winikoff, M.: Developing Intelligent Agent Systems: A Practical Guide. John Wiley & Sons (2004)Google Scholar
  23. 23.
    Parnas, D.: On the criteria to be used in decomposing systems into modules. Commun ACM 15(12), 1053–1058 (1972)CrossRefGoogle Scholar
  24. 24.
    Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Prentice Hall, Upper Saddle River (1995)zbMATHGoogle Scholar
  25. 25.
    Shoham, Y.: Agent-oriented programming. Artif. Intell. 60(1), 51–92 (1993)CrossRefMathSciNetGoogle Scholar
  26. 26.
    Slonneger, K., Kurtz, B.L.: Formal Syntax and Semantics of Programming Languages: A Laboratory Based Approach. Addison-Wesley Publishing Company, Reading (1995)zbMATHGoogle Scholar
  27. 27.
    Staniak, M., Zieliński, C.: Structures of visual servos. Robot. Auton. Syst. 58(8), 940–954 (2010). doi: 10.1016/j.robot.2010.04.004 CrossRefGoogle Scholar
  28. 28.
    Suzuki, S., Abe, K.: Topological structural analysis of digitized binary images by border following. Comput. Vis. Graph. Image Process. 30(1), 32–46 (1985)CrossRefzbMATHGoogle Scholar
  29. 29.
    Tang, F., Parker, L.: A complete methodology for generating multi-robot task solutions using ASyMTRe-D and market-based task allocation. In: IEEE International Conference on Robotics and Automation 2007, pp. 3351–3358. IEEE (2007)Google Scholar
  30. 30.
    Tonko, M., Schurmann, J., Schafer, K., Nagel, H.: Visually servoed gripping of a used car battery. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), vol. 1, pp. 49–54 (1997)Google Scholar
  31. 31.
    Zieliński, C.: A quasi-formal approach to structuring multi-robot system controllers. In: Second International Workshop on Robot Motion and Control, RoMoCo’01, pp. 121–128 (2001)Google Scholar
  32. 32.
    Zieliński, C.: By how much should a general purpose programming language be extended to become a multi-robot system programming language? Adv. Robot. 15(1), 71–96 (2001)CrossRefGoogle Scholar
  33. 33.
    Zieliński, C.: A unified formal description of behavioural and deliberative robotic multi-agent systems. In: Proc. 7th IFAC International Symposium on Robot Control SYROCO 2003, Wrocław, Poland, vol. 2, pp. 479–486 (2003)Google Scholar
  34. 34.
    Zieliński, C.: Specification of behavioural embodied agents. In: Kozłowski, K. (ed.) Fourth International Workshop on Robot Motion and Control (RoMoCo’04), pp. 79–84 (2004)Google Scholar
  35. 35.
    Zieliński, C.: Transition-function based approach to structuring robot control software. In: Kozłowski, K. (ed.) Robot Motion and Control. Lecture Notes in Control and Information Sciences, vol. 335, pp. 265–286. Springer-Verlag (2006)Google Scholar
  36. 36.
    Zieliński, C., Kasprzak, W., Kornuta, T., Szynkiewicz, W., Trojanek, P., Walecki, M., Winiarski, T., Zielińska, T.: Control and programming of a multi-robot-based reconfigurable fixture. Ind. Robot Int. J. 40(4), 329–336 (2013)CrossRefGoogle Scholar
  37. 37.
    Zieliński, C., Kornuta, T., Boryń, M.: Specification of robotic systems on an example of visual servoing. In: 10th International IFAC Symposium on Robot Control (SYROCO 2012), vol. 10, pp. 45–50 (2012)Google Scholar
  38. 38.
    Zieliński, C., Szynkiewicz, W., Winiarski, T., Staniak, M., Czajewski, W., Kornuta, T.: Rubik’s cube as a benchmark validating MRROC+ + as an implementation tool for service robot control systems. Ind. Robot. Int. J. 34(5), 368–375 (2007)CrossRefGoogle Scholar
  39. 39.
    Zieliński, C., Trojanek, P.: Stigmergic cooperation of autonomous robots. J. Mech. Mach. Theory 44, 656–670 (2009)CrossRefzbMATHGoogle Scholar
  40. 40.
    Zielński, C., Winiarski, T.: Motion generation in the MRROC+ + robot programming framework. Int. J. Robot. Res. 29(4), 386–413 (2010)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2013

Authors and Affiliations

  1. 1.Institute of Control and Computation EngineeringWarsaw University of TechnologyWarsawPoland

Personalised recommendations