Computer Vision with Cognitive Learning to Improve the Decision-Making During the Sales Process in Physical Stores

  • Vinícius da Silva Ramalho
  • Anderson Luis SzejkaEmail author
  • Marcelo Rudek
  • Osiris Canciglieri Junior
Conference paper
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 565)


In a world where the information is obtained faster than ever seem, new methods to process that high volume of data are being developed frequently. This is more notorious in a virtual ambient where the data is generated in a manner that is faster and easier to analyze than in the real world. This is very evident in the retail field, where virtual stores have easy access to all the advertisement a user visited and simple to obtain user profile, on the other hand physical stores are limited to basically create a register in a database when there is a purchase. In an attempt to improve the retailers experience from physical stores to manage their business this document has the objective to develop a computational tool that will analyze the people flux going in the establishment, trying to inform the retailer the amount of people and their gender to help the sales process in physical stores. To this end, computational vision methods and algorithms were raised, which after selection, theoretical conception and tool’s implementation it was tested with benchmarks to operate locally and in real time by accessing the cameras installed strategically in a real scenario. Two scenarios were tested: static ambient light and dynamic light. Two tests were conducted: YOLOv2 against background subtraction-based counter; gender classification using full body features. Even though the results were not as positive as needed for commercial use, the tool demonstrated potential and space for improvements.


Smart retail Retail 4.0 Computer vision Intelligent systems 


  1. 1.
    Hwangbo, H., Kim, Y.S., Cha, K.J.: Use of the smart store for persuasive marketing and immersive customer experiences: a case study of Korean apparel enterprise. Mobile Inf. Syst. 2017, 1–17 (2017)CrossRefGoogle Scholar
  2. 2.
    Quintana, M., Menéndez, J.M., Alvarez, F., Lopez, J.P.: Improving retail efficiency through sensing technologies: a survey. Pattern Recogn. Lett. 81, 3–10 (2016)CrossRefGoogle Scholar
  3. 3.
    Rocha, M.A.V., Hammond, H., Hawkins, D.: Age, gender and national factors in fashion consumption. J. Fash. Mark. Manag.: Int. J. 9(4), 380–390 (2005)CrossRefGoogle Scholar
  4. 4.
    Jayaram, A.: Smart Retail 4.0 IoT consumer retailer model for retail intelligence and strategic marketing of in-store products (2017)Google Scholar
  5. 5.
    Karim, N.T., Jain, S., Moonrinta, J., Dailey, M.N., Ekpanyapong, M.: Customer and target individual face analysis for retail analytics. In: 2018 International Workshop on Advanced Image Technology (IWAIT), pp. 1–4. IEEE, January 2018Google Scholar
  6. 6.
    Jeeva, S., Sivabalakrishnan, M.: Survey on background modeling and foreground detection for real time video surveillance. Procedia Comput. Sci. 50, 566–571 (2015)CrossRefGoogle Scholar
  7. 7.
    Desai, H.M.: A survey: background subtraction techniques. Int. J. Sci. Eng. Res. 5(12), 1365–1367 (2014)Google Scholar
  8. 8.
    Takahara, K., Tori, T., Zin, T.: Making background subtraction robust to various illumination changes. Int. J. Comput. Sci. Netw. Secur. 11(3), 241–248 (2011)Google Scholar
  9. 9.
    Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818–833. Springer, Cham (2014). Scholar
  10. 10.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017)CrossRefGoogle Scholar
  11. 11.
    Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection, pp. 779–788 (2016).
  12. 12.
    Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, pp. 6517–6525 (2017)Google Scholar
  13. 13.
    Sokolova, M., Japkowicz, N., Szpakowicz, S.: Beyond accuracy, F-Score and ROC: a family of discriminant measures for performance evaluation. In: Sattar, A., Kang, B. (eds.) AI 2006. LNCS (LNAI), vol. 4304, pp. 1015–1021. Springer, Heidelberg (2006). Scholar

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  1. 1.Industrial and Systems Engineering Graduate ProgramPontifical Catholic University of ParanaCuritibaBrazil

Personalised recommendations