Applied Intelligence

, Volume 36, Issue 2, pp 407–423 | Cite as

Hybrid laser pointer detection algorithm based on template matching and fuzzy rule-based systems for domotic control in real home environments

  • F. Chávez
  • F. Fernández
  • R. Alcalá
  • J. Alcalá-Fdez
  • G. Olague
  • F. Herrera


A fundamental problem for disabled or elderly people is to manage their homes while carrying out an almost normal life, which implies using and interacting with a number of home devices. Recent studies in smart homes have proposed methods to use a laser pointer for interacting with home devices, which represents a more user-friendly and less expensive home device control environment. However, detecting the laser spot on the original non-filtered images, using standard and non-expensive cameras, and considering real home environments with varying conditions, is currently an open problem.

This paper proposes a hybrid technique, where a classic technique used in image detection processes, such as Template Matching, has been combined with a Fuzzy Rule Based System for detecting a laser spot in real home environments. The idea is to use this new approach to improve the success rate of the previous algorithms used for detecting the laser spot, decreasing as much as possible the false offs of the system, because, the detection of a false laser spot could lead to dangerous situations.

Using this new hybrid technique a better success rate has been obtained, eliminating almost completely the possibility of dangerous situations that may occur due to incorrect detection of the laser spot in real home environments.


Fuzzy rule based systems Template matching Laser pointer detection Disabled people Domotic control systems 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Declaration on the rights of disabled persons (1975) Google Scholar
  2. 2.
    Aguirre E, González A (2003) A fuzzy perceptual model for ultrasound sensors applied to intelligent navigation of mobile robots. Appl Intell 19(3):171–187 CrossRefGoogle Scholar
  3. 3.
    Ahlborn BA, Thompson D, Kreylos O, Hamann B, Staadt O (2005) A practical system for laser pointer interaction on large displays. In: VRST ’05: Proceedings of the ACM symposium on virtual reality software and technology. ACM, Monterey, CA, USA, pp 106–109 CrossRefGoogle Scholar
  4. 4.
    Alcalá R, Alcalá-Fdez J, Gacto M, Herrera F (2009) Improving fuzzy logic controllers obtained by experts: a case study in HVAC systems. Appl Intell 31(1):15–30 CrossRefGoogle Scholar
  5. 5.
    Alcalá R, Benítez JM, Casillas J, Cordón O, Pérez R (2003) Fuzzy control of HVAC systems optimized by genetic algorithms. Appl Intell 18(2):155–177 zbMATHCrossRefGoogle Scholar
  6. 6.
    Alcalá R, Casillas J, Cordón O, González A, Herrera F (2005) A genetic rule weighting and selection process for fuzzy control of heating, ventilating and air conditioning systems. Eng Appl Artif Intell 18(3):279–296 CrossRefGoogle Scholar
  7. 7.
    Aldrich F (2003) Smart homes: past, present and future. In: Inside the Smart Home, pp 17–39 CrossRefGoogle Scholar
  8. 8.
    Bardossy A, Duckstein L (1995) Fuzzy rule-based modeling with application to geophysical, biological and engineering systems. CRC Press, Boca Raton Google Scholar
  9. 9.
    Basicevic I, Kukolj D, Popovic M (2009) On the application of fuzzy-based flow control approach to high altitude platform communications. Appl Intell, 1–12 Google Scholar
  10. 10.
    Borkowski S, Letessier J, Crowley JL (2005) Spatial control of interactive surfaces in an augmented environment. In: Lecture notes in computer science, vol 3425. Springer, Berlin, pp 228–244 Google Scholar
  11. 11.
    Brad AM, Rishi B, Jeffrey N, Hong PC, Dave K, Robert M, Chris LA (2002) Interacting at a distance: measuring the performance of laser pointers and other devices. In: CHI ’02: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Minneapolis, Minnesota, USA, pp 33–40 Google Scholar
  12. 12.
    Brown MS, Wong WKH (2003) Laser pointer interaction for camera-registered multiprojector displays. In: IEEE international conference on image processing, Barcelona, Spain, pp 913–916 Google Scholar
  13. 13.
    Brunelli R (2009) Template matching techniques in computer vision: theory and practice. Wiley, Chichester CrossRefGoogle Scholar
  14. 14.
    Charles CK, Cressel DA, Hai N, Alexander JT, Zhe X (2008) A point-and-click interface for the real world: laser designation of objects for mobile manipulation. In: HRI ’08: Proceedings of the 3rd ACM/IEEE international conference on human robot interaction. ACM, Amsterdam, The Netherlands, pp 241–248 Google Scholar
  15. 15.
    Chávez F, Fernández F, Olague G, Llano J (2008) An independent and non-intrusive laser pointer environment control device system. In: ICPS ’08: Proceedings of the 5th international conference on pervasive services. ACM, Sorrento, Italy, pp 37–46 CrossRefGoogle Scholar
  16. 16.
    Cincotti F, Mattia D, Aloise F, Bufalari S, Schalk G, Oriolo G, Cherubini A, Marciani MG, Babiloni F (2008) Non-invasive brain-computer interface system: towards its application as assistive technology. Brain Res Bull 75(6):796–803 CrossRefGoogle Scholar
  17. 17.
    Cordón O, Herrera F, Peregrín A (1997) Applicability of the fuzzy operators in the design of fuzzy logic controllers. Fuzzy Sets Syst 86(1):15–41 zbMATHCrossRefGoogle Scholar
  18. 18.
    Davis J, Chen X (2002) Lumipoint: multi-user laser-based interaction on large tiled displays. Displays 23(5):205–211 CrossRefGoogle Scholar
  19. 19.
    Driankov D, Hellendoorn H, Reinfrank M (1996) An introduction to fuzzy control, 2nd edn. Springer, London zbMATHGoogle Scholar
  20. 20.
    Dufour RM, Miller EL, Galatsanos NP (2002) Template matching based object recognition with unknown geometric parameters. IEEE Trans Image Process 11(12):1385–1396 MathSciNetCrossRefGoogle Scholar
  21. 21.
    Gacto MJ, Alcalá R, Herrera F (2010) A multi-objective evolutionary algorithm for an effective tuning of fuzzy logic controllers in heating, ventilating and air conditioning systems. Appl Intell, DOI: 10.1007/s10489-010-0264-x
  22. 22.
    Goossens M (1998) The EIB system for home and building electronics. The EIB handbook series. The EIB Association, Brussels Google Scholar
  23. 23.
    United Nations and disabled people:
  24. 24.
    World Health Organization:
  25. 25.
    International Electrotechnical Commission Portal:
  26. 26.
    Jiang L, Liu D, Yang B (2005) Smart home research. Proceedings of 2004 international conference on machine learning and cybernetics, 2004, vol 2, pp 659–663 Google Scholar
  27. 27.
    KNX Association:
  28. 28.
    Kadouchel R, Abdulrazakl B, Mokhtari M, Girouxl S, Pigot H (2009) Personalization and multi-user management in smart homes for disabled people. Int J Smart Home 3(1):39–48 Google Scholar
  29. 29.
    Kim NW, Lee SJ, Lee BG, Lee JJ (2007) Vision based laser pointer interaction for flexible screens. In: Jacko JA (ed.) Proceedings of the 12th international conference on human-computer interaction: interaction platforms and techniques, vol 4551. Springer, Berlin pp 845–853 CrossRefGoogle Scholar
  30. 30.
    Kirstein C, Mueller H (1998) Interaction with a projection screen using a camera-tracked laser pointer. In: Multi-media modeling conference international, p 191 Google Scholar
  31. 31.
  32. 32.
    Latoschik ME, Bomberg E (2007) Augmenting a laser pointer with a diffraction grating for monoscopic 6dof detection. J Virtual Real Broadcast 4(14) Google Scholar
  33. 33.
    Mamdani EH (1974) Application of fuzzy algorithms for control of simple dynamic plant. Proc Inst Electr Eng 121(12):1585–1588 CrossRefGoogle Scholar
  34. 34.
    Mamdani EH, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man-Mach Stud 7(1):1–13 zbMATHCrossRefGoogle Scholar
  35. 35.
    Marie C, Daniel E, Christophe E, Eric C (2008) A review of smart homes-present state and future challenges. Comput Methods Programs Biomed 91(1):55–81 CrossRefGoogle Scholar
  36. 36.
    Matveyev S, Göbel M (2003) Direct interaction based on a two-point laser pointer technique. In: Rockwood AP (ed.) International conference on computer graphics and interactive techniques. ACM New York, NY, USA, San Diego, California, p 1 Google Scholar
  37. 37.
    Oh JY, Stuerzlinger W (2002) Laser pointers as collaborative pointing devices. In: Proceedings graphics interface, Calgary, Alberta, pp 141–150 Google Scholar
  38. 38.
    Olague G, Fernández F, Pérez C, Lutton E (2006) The infection algorithm: an artificial epidemic approach for dense stereo correspondence. Artif Life 12(4):593–615 CrossRefGoogle Scholar
  39. 39.
    Olsen J, Dan R, Travis N (2001) Laser pointer interaction. In: CHI ’01: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Seattle, Washington, United States, pp 17–22 CrossRefGoogle Scholar
  40. 40.
    Orpwood R, Gibbs C, Adlam T, Faulkner R, Meegahawatte D (2005) The design of smart homes for people with dementia—user-interface aspects. Univers Access Inf Soc 4(2):156–164 CrossRefGoogle Scholar
  41. 41.
    Park J, Hsu C, Arabnia H (2009) Intelligent systems and smart homes. Inf Syst Front 11(5):481–482 CrossRefGoogle Scholar
  42. 42.
    Park KH, Bien Z, Lee JJ, Kim BK, Lim JT, Kim JO, Lee H, Stefanov DH, Kim DJ, Jung JW, Do JH, Seo KH, Kim CH, Song WG, Lee WJ (2007) Robotic smart house to assist people with movement disabilities. Auton Robots 22(2):183–198 CrossRefGoogle Scholar
  43. 43.
    Portal W3J:
  44. 44.
    Pratt WK (2001) Digital image processing. Wiley, Chichester CrossRefGoogle Scholar
  45. 45.
    Rialle V, Duchene F, Noury N, Bajolle L, Demongeot J (2002) Health “smart” home: information technology for patients at home. Telemed J and e-Health 8(4):395–409 CrossRefGoogle Scholar
  46. 46.
    Shizuki B, Hisamatsu T, Takahashi S, Tanaka J (2006) Laser pointer interaction techniques using peripheral areas of screens. In: Celentano A (ed.) Proceedings of the working conference on advanced visual interfaces. ACM, New York, USA, Venezia, Italy, pp 95–98 CrossRefGoogle Scholar
  47. 47.
    Wang LX (1994) Adaptive fuzzy systems and control. Design and stability analysis. Prentice Hall, New York Google Scholar
  48. 48.
    Werntges HW, Neumann J, Vinarski V (2005) Controlling EIB/KNX devices from Linux using USB. In: Tagungsband Konnex scientific conference, p 1 Google Scholar
  49. 49.
    Wilson E, Karr C, Bennett J (2004) An adaptive, intelligent control system for slag foaming. Appl Intell 20(2):165–177 zbMATHCrossRefGoogle Scholar
  50. 50.
    Xiaojun B, Yuanchun S, Xiaojie C (2006) Upen: a smart pen-liked device for facilitating interaction on large displays. In: TABLETOP ’06: Proceedings of the first IEEE international workshop on horizontal interactive human-computer systems. IEEE Computer Society, Adelaide, pp 160–168. CrossRefGoogle Scholar
  51. 51.
    Zadeh LA (1973) Outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybern SMC-3:28–44 MathSciNetCrossRefGoogle Scholar
  52. 52.
    Zadeh LA (2008) Is there a need for fuzzy logic? Inf Sci 178:2751–2779 MathSciNetzbMATHCrossRefGoogle Scholar
  53. 53.
    Zhang L, Shi Y, Chen J (2006) Drag and drop by laser pointer: seamless interaction with multiple large displays. In: Lecture notes in computer science, vol 4159. Springer, Berlin, pp 12–20 Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  • F. Chávez
    • 1
  • F. Fernández
    • 1
  • R. Alcalá
    • 2
  • J. Alcalá-Fdez
    • 2
  • G. Olague
    • 3
  • F. Herrera
    • 2
  1. 1.Department of Computer ScienceUniversity of ExtremaduraMéridaSpain
  2. 2.Department of Computer Science and Artificial Intelligence, Research Center on Information and Communications TechnologyUniversity of GranadaGranadaSpain
  3. 3.Department of Computer ScienceCICESE Research CenterSan DiegoUSA

Personalised recommendations